Jul 16 00:12:42.049102 ip-10-0-131-255 systemd[1]: Starting Kubernetes Kubelet... Jul 16 00:12:42.422671 ip-10-0-131-255 kubenswrapper[2557]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:12:42.422671 ip-10-0-131-255 kubenswrapper[2557]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 16 00:12:42.422671 ip-10-0-131-255 kubenswrapper[2557]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:12:42.422671 ip-10-0-131-255 kubenswrapper[2557]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 16 00:12:42.422671 ip-10-0-131-255 kubenswrapper[2557]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 16 00:12:42.423441 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.422736 2557 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 16 00:12:42.427678 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427658 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:12:42.427678 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427676 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:12:42.427678 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427682 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427689 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427696 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427700 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427704 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427708 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427711 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427716 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427719 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427723 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427727 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427731 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427735 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427738 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427742 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427746 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427749 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427753 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427757 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427760 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:12:42.427941 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427764 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427783 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427788 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427792 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427796 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427801 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427804 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427809 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427813 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427816 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427820 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427824 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427828 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427832 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427837 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427842 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427847 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427851 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427855 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:12:42.428723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427859 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427864 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427869 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427873 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427880 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427885 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427888 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427892 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427897 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427900 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427904 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427908 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427912 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427916 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427920 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427924 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427928 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427932 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427936 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427940 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:12:42.429512 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427944 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427947 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427951 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427955 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427959 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427963 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427967 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427973 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427978 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427984 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427989 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427993 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.427997 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428001 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428005 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428009 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428015 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428020 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428024 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428028 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:12:42.430330 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428032 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428036 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428040 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428045 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428049 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428055 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428062 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428066 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428071 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428075 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428080 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428084 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428089 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428096 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428099 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428103 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428108 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.428112 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429231 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:12:42.431164 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429240 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429244 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429249 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429254 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429258 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429263 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429267 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429270 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429275 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429279 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429283 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429287 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429291 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429295 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429300 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429304 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429308 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429312 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429316 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429321 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:12:42.431946 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429325 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429329 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429333 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429338 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429343 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429347 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429352 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429356 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429360 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429364 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429368 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429372 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429376 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429380 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429384 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429388 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429393 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429397 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429401 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429405 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:12:42.432564 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429410 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429413 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429418 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429422 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429426 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429430 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429433 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429437 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429441 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429448 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429453 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429460 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429464 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429468 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429472 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429476 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429481 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429485 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429489 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:12:42.433135 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429493 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429497 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429501 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429505 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429509 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429513 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429517 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429521 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429525 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429529 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429534 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429538 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429543 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429547 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429559 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429563 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429567 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429572 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429576 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429580 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:12:42.433633 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429584 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429588 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429592 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429597 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429603 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429607 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429616 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429620 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429625 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429629 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429634 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429638 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429642 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429646 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429650 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429654 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429658 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429665 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.429671 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430267 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:12:42.434299 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430275 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430280 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430285 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430289 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430293 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430297 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430301 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430308 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430314 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430319 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430323 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430327 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430331 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430334 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430338 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430342 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430346 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430349 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430354 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:12:42.434759 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430358 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430363 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430368 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430372 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430376 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430380 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430384 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430388 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430392 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430396 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430400 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430404 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430408 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430412 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430415 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430420 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430424 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430428 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430432 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430436 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:12:42.435260 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430439 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430443 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430447 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430451 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430455 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430459 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430463 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430466 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430470 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430474 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430478 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430483 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430487 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430491 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430495 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430499 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430503 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430508 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430512 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430516 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:12:42.435756 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430519 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430523 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430529 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430532 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430537 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430541 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430545 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430550 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430556 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430563 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430568 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430573 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430579 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430583 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430587 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430591 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430596 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430600 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430606 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:12:42.436236 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430611 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430616 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430620 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430624 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430628 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430633 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430637 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430641 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430645 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430649 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430653 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430657 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430661 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430665 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430670 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430674 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430677 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430682 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430686 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.430690 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:12:42.436765 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430800 2557 flags.go:64] FLAG: --address="0.0.0.0" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430810 2557 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430820 2557 flags.go:64] FLAG: --anonymous-auth="true" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430828 2557 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430834 2557 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430840 2557 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430846 2557 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430853 2557 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430858 2557 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430862 2557 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430868 2557 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430873 2557 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430878 2557 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430883 2557 flags.go:64] FLAG: --cgroup-root="" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430887 2557 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430891 2557 flags.go:64] FLAG: --client-ca-file="" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430897 2557 flags.go:64] FLAG: --cloud-provider="external" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430901 2557 flags.go:64] FLAG: --cluster-dns="[]" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430908 2557 flags.go:64] FLAG: --cluster-domain="" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430912 2557 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430917 2557 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430922 2557 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430927 2557 flags.go:64] FLAG: --container-log-max-files="5" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430939 2557 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 16 00:12:42.437249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430944 2557 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430949 2557 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430955 2557 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430959 2557 flags.go:64] FLAG: --contention-profiling="false" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430963 2557 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430968 2557 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430972 2557 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430977 2557 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430983 2557 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430988 2557 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430993 2557 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.430997 2557 flags.go:64] FLAG: --enable-load-reader="false" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431002 2557 flags.go:64] FLAG: --enable-server="true" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431007 2557 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431013 2557 flags.go:64] FLAG: --event-burst="100" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431018 2557 flags.go:64] FLAG: --event-qps="50" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431022 2557 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431027 2557 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431031 2557 flags.go:64] FLAG: --eviction-hard="" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431037 2557 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431041 2557 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431046 2557 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431050 2557 flags.go:64] FLAG: --eviction-soft="" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431055 2557 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431064 2557 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 16 00:12:42.437851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431068 2557 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431073 2557 flags.go:64] FLAG: --experimental-mounter-path="" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431077 2557 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431081 2557 flags.go:64] FLAG: --fail-swap-on="true" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431086 2557 flags.go:64] FLAG: --feature-gates="" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431091 2557 flags.go:64] FLAG: --file-check-frequency="20s" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431096 2557 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431101 2557 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431106 2557 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431110 2557 flags.go:64] FLAG: --healthz-port="10248" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431115 2557 flags.go:64] FLAG: --help="false" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431120 2557 flags.go:64] FLAG: --hostname-override="ip-10-0-131-255.ec2.internal" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431124 2557 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431129 2557 flags.go:64] FLAG: --http-check-frequency="20s" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431133 2557 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431139 2557 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431144 2557 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431150 2557 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431155 2557 flags.go:64] FLAG: --image-service-endpoint="" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431159 2557 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431164 2557 flags.go:64] FLAG: --kube-api-burst="100" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431169 2557 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431174 2557 flags.go:64] FLAG: --kube-api-qps="50" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431178 2557 flags.go:64] FLAG: --kube-reserved="" Jul 16 00:12:42.438512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431182 2557 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431186 2557 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431191 2557 flags.go:64] FLAG: --kubelet-cgroups="" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431196 2557 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431200 2557 flags.go:64] FLAG: --lock-file="" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431205 2557 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431210 2557 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431217 2557 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431226 2557 flags.go:64] FLAG: --log-json-split-stream="false" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431230 2557 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431235 2557 flags.go:64] FLAG: --log-text-split-stream="false" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431240 2557 flags.go:64] FLAG: --logging-format="text" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431244 2557 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431249 2557 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431254 2557 flags.go:64] FLAG: --manifest-url="" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431258 2557 flags.go:64] FLAG: --manifest-url-header="" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431265 2557 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431269 2557 flags.go:64] FLAG: --max-open-files="1000000" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431276 2557 flags.go:64] FLAG: --max-pods="110" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431281 2557 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431285 2557 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431289 2557 flags.go:64] FLAG: --memory-manager-policy="None" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431294 2557 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431298 2557 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431303 2557 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 16 00:12:42.439214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431309 2557 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431320 2557 flags.go:64] FLAG: --node-status-max-images="50" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431325 2557 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431329 2557 flags.go:64] FLAG: --oom-score-adj="-999" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431335 2557 flags.go:64] FLAG: --pod-cidr="" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431339 2557 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431347 2557 flags.go:64] FLAG: --pod-manifest-path="" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431352 2557 flags.go:64] FLAG: --pod-max-pids="-1" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431357 2557 flags.go:64] FLAG: --pods-per-core="0" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431362 2557 flags.go:64] FLAG: --port="10250" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431367 2557 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431371 2557 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ad465a0cbdb5c280" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431376 2557 flags.go:64] FLAG: --qos-reserved="" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431381 2557 flags.go:64] FLAG: --read-only-port="10255" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431386 2557 flags.go:64] FLAG: --register-node="true" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431392 2557 flags.go:64] FLAG: --register-with-taints="" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431398 2557 flags.go:64] FLAG: --registry-burst="10" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431403 2557 flags.go:64] FLAG: --registry-qps="5" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431407 2557 flags.go:64] FLAG: --reserved-cpus="" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431412 2557 flags.go:64] FLAG: --reserved-memory="" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431417 2557 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431422 2557 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431427 2557 flags.go:64] FLAG: --rotate-certificates="false" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431431 2557 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431436 2557 flags.go:64] FLAG: --runonce="false" Jul 16 00:12:42.440030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431440 2557 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431444 2557 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431449 2557 flags.go:64] FLAG: --seccomp-default="false" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431453 2557 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431458 2557 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431462 2557 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431467 2557 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431473 2557 flags.go:64] FLAG: --storage-driver-password="root" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431478 2557 flags.go:64] FLAG: --storage-driver-secure="false" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431483 2557 flags.go:64] FLAG: --storage-driver-table="stats" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431487 2557 flags.go:64] FLAG: --storage-driver-user="root" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431491 2557 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431497 2557 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431501 2557 flags.go:64] FLAG: --system-cgroups="" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431506 2557 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431514 2557 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431519 2557 flags.go:64] FLAG: --tls-cert-file="" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431523 2557 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431530 2557 flags.go:64] FLAG: --tls-min-version="" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431534 2557 flags.go:64] FLAG: --tls-private-key-file="" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431538 2557 flags.go:64] FLAG: --topology-manager-policy="none" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431543 2557 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431549 2557 flags.go:64] FLAG: --topology-manager-scope="container" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431554 2557 flags.go:64] FLAG: --v="2" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431560 2557 flags.go:64] FLAG: --version="false" Jul 16 00:12:42.440616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431566 2557 flags.go:64] FLAG: --vmodule="" Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431572 2557 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.431577 2557 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431745 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431753 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431759 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431764 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431784 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431789 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431793 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431797 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431802 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431805 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431810 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431815 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431820 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431823 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431827 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431832 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:12:42.441222 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431835 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431841 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431845 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431849 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431853 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431858 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431862 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431865 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431869 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431873 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431879 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431883 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431888 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431892 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431896 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431900 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431904 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431908 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431913 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431917 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:12:42.441691 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431921 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431925 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431929 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431933 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431937 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431941 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431945 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431950 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431954 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431958 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431962 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431967 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431971 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431975 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431983 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431988 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431993 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.431997 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432001 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:12:42.442168 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432005 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432009 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432013 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432019 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432023 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432027 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432031 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432035 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432039 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432044 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432048 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432052 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432056 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432060 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432065 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432068 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432073 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432077 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432081 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432085 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:12:42.442615 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432090 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432094 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432099 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432103 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432107 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432110 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432114 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432119 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432123 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432129 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432133 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432137 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432141 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432145 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432149 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432155 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432159 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432163 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432167 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432171 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:12:42.443176 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432175 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432180 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432186 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.432192 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.432860 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.440588 2557 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.440602 2557 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.440622 2557 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.440632 2557 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440685 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440690 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440694 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440698 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440702 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:12:42.443640 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440704 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440707 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440710 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440714 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440718 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440721 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440724 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440726 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440729 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440731 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440734 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440736 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440739 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440741 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440744 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440746 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440749 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440751 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440754 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440757 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:12:42.443994 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440760 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440762 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440765 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440767 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440785 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440788 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440790 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440793 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440796 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440798 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440801 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440803 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440806 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440809 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440812 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440814 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440817 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440821 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440825 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:12:42.444453 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440828 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440830 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440834 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440836 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440839 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440841 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440844 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440847 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440849 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440852 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440854 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440856 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440859 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440861 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440864 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440866 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440868 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440872 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440875 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440877 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:12:42.444918 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440880 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440883 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440885 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440888 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440891 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440893 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440895 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440898 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440900 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440902 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440905 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440908 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440910 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440912 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440915 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440918 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440921 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440923 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440925 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440928 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:12:42.445374 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440931 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440933 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440935 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440938 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440940 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440942 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440945 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440947 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440950 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440953 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440955 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440958 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440960 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440963 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.440965 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:12:42.445859 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.440970 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441096 2557 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441101 2557 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441104 2557 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441107 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441110 2557 feature_gate.go:328] unrecognized feature gate: Example2 Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441112 2557 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441115 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441117 2557 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441120 2557 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441122 2557 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441125 2557 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441127 2557 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441130 2557 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441133 2557 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441135 2557 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441138 2557 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441140 2557 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441142 2557 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441145 2557 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 16 00:12:42.446209 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441147 2557 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441150 2557 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441152 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441155 2557 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441157 2557 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441160 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441162 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441165 2557 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441167 2557 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441171 2557 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441174 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441177 2557 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441181 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441183 2557 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441186 2557 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441189 2557 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441191 2557 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441194 2557 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441196 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441198 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 16 00:12:42.446670 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441201 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441203 2557 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441205 2557 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441208 2557 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441210 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441212 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441216 2557 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441218 2557 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441221 2557 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441223 2557 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441226 2557 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441228 2557 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441231 2557 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441233 2557 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441236 2557 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441238 2557 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441241 2557 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441243 2557 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441246 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 16 00:12:42.447149 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441248 2557 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441251 2557 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441253 2557 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441255 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441258 2557 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441260 2557 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441263 2557 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441265 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441268 2557 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441270 2557 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441272 2557 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441275 2557 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441277 2557 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441280 2557 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441282 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441284 2557 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441287 2557 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441289 2557 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441291 2557 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441294 2557 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 16 00:12:42.447579 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441297 2557 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441300 2557 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441302 2557 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441304 2557 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441307 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441309 2557 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441312 2557 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441315 2557 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441319 2557 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441321 2557 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441324 2557 feature_gate.go:328] unrecognized feature gate: Example Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441328 2557 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441332 2557 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441335 2557 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441337 2557 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441340 2557 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441342 2557 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441345 2557 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441347 2557 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 16 00:12:42.448045 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441350 2557 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:42.441352 2557 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.441357 2557 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.441456 2557 server.go:962] "Client rotation is on, will bootstrap in background" Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.443712 2557 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.445053 2557 server.go:1019] "Starting client certificate rotation" Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.445157 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.445189 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 16 00:12:42.448470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.447731 2557 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:12:42.450674 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.450657 2557 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 16 00:12:42.461060 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.461045 2557 log.go:25] "Validated CRI v1 runtime API" Jul 16 00:12:42.464018 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.464004 2557 log.go:25] "Validated CRI v1 image API" Jul 16 00:12:42.464837 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.464822 2557 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 16 00:12:42.467351 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.467328 2557 fs.go:135] Filesystem UUIDs: map[13b78344-7d9b-4cb8-a8a6-5c32faadbe0c:/dev/nvme0n1p4 42b69e4e-a490-453e-b379-99427aca3641:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jul 16 00:12:42.467417 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.467351 2557 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 16 00:12:42.472893 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.472754 2557 manager.go:216] Machine: {Timestamp:2026-07-16 00:12:42.471473953 +0000 UTC m=+0.309528521 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3191018 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28decb429bc62778b79e9567407a89 SystemUUID:ec28decb-429b-c627-78b7-9e9567407a89 BootID:9a1f1567-975e-47c7-a9ac-d0f9796c9dd1 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:73:52:72:49:c1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:73:52:72:49:c1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:4d:45:18:e0:78 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 16 00:12:42.472893 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.472873 2557 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 16 00:12:42.473016 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.472957 2557 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 16 00:12:44.243640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:42.473158 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:12:44.246422 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.246373 2557 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 16 00:12:44.246721 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.246424 2557 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-255.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 16 00:12:44.248233 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.248062 2557 topology_manager.go:138] "Creating topology manager with none policy" Jul 16 00:12:44.248309 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.248239 2557 container_manager_linux.go:309] "Creating device plugin manager" Jul 16 00:12:44.248309 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.248250 2557 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:12:44.248949 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.248936 2557 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 16 00:12:44.250625 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.250613 2557 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 16 00:12:44.254904 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.254890 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:12:44.255085 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255073 2557 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 16 00:12:44.255155 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255112 2557 kubelet.go:486] "Attempting to sync node with API server" Jul 16 00:12:44.255155 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255127 2557 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 16 00:12:44.255155 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255145 2557 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 16 00:12:44.255274 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255158 2557 kubelet.go:398] "Adding apiserver pod source" Jul 16 00:12:44.255274 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255170 2557 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 16 00:12:44.255555 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255541 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:12:44.255618 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.255563 2557 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 16 00:12:44.257766 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.257748 2557 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 16 00:12:44.259877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.259863 2557 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 16 00:12:44.259933 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.259894 2557 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 16 00:12:44.260072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260063 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 16 00:12:44.260105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260078 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 16 00:12:44.260105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260084 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 16 00:12:44.260105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260090 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 16 00:12:44.260105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260098 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 16 00:12:44.260105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260104 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 16 00:12:44.260573 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260563 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 16 00:12:44.260573 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260572 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 16 00:12:44.260663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260579 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 16 00:12:44.260663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260585 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 16 00:12:44.260663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260593 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 16 00:12:44.260663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.260602 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 16 00:12:44.262230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.262220 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 16 00:12:44.262230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.262229 2557 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 16 00:12:44.265323 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.265310 2557 server.go:1268] "Started kubelet" Jul 16 00:12:44.265436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.265382 2557 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 16 00:12:44.265527 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.265436 2557 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 16 00:12:44.265831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.265700 2557 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 16 00:12:44.265831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.265791 2557 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-255.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 16 00:12:44.265831 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.265806 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 16 00:12:44.266018 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.265889 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 16 00:12:44.266214 ip-10-0-131-255 systemd[1]: Started Kubernetes Kubelet. Jul 16 00:12:44.267508 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.267492 2557 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 16 00:12:44.267935 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.267922 2557 server.go:310] "Adding debug handlers to kubelet server" Jul 16 00:12:44.270819 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.270803 2557 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 16 00:12:44.273013 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.272003 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-255.ec2.internal.18c29cc32038baff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-255.ec2.internal,UID:ip-10-0-131-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-255.ec2.internal,},FirstTimestamp:2026-07-16 00:12:44.265282303 +0000 UTC m=+0.333145582,LastTimestamp:2026-07-16 00:12:44.265282303 +0000 UTC m=+0.333145582,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-255.ec2.internal,}" Jul 16 00:12:44.273304 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.273285 2557 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 16 00:12:44.273304 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.273294 2557 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 16 00:12:44.273449 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.273383 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.274050 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274022 2557 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 16 00:12:44.274050 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274036 2557 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 16 00:12:44.274050 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274048 2557 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 16 00:12:44.274230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274127 2557 reconstruct.go:97] "Volume reconstruction finished" Jul 16 00:12:44.274230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274134 2557 reconciler.go:29] "Reconciler: start to sync state" Jul 16 00:12:44.274230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274157 2557 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 16 00:12:44.274230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274169 2557 factory.go:55] Registering systemd factory Jul 16 00:12:44.274230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274178 2557 factory.go:223] Registration of the systemd container factory successfully Jul 16 00:12:44.274451 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274351 2557 factory.go:153] Registering CRI-O factory Jul 16 00:12:44.274451 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274359 2557 factory.go:223] Registration of the crio container factory successfully Jul 16 00:12:44.274451 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274375 2557 factory.go:103] Registering Raw factory Jul 16 00:12:44.274451 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274385 2557 manager.go:1196] Started watching for new ooms in manager Jul 16 00:12:44.274943 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.274925 2557 manager.go:349] Starting recovery of all containers Jul 16 00:12:44.278233 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.278176 2557 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-255.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 16 00:12:44.278765 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.278743 2557 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 16 00:12:44.286717 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.286562 2557 manager.go:354] Recovery completed Jul 16 00:12:44.290443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.290423 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kbhzf" Jul 16 00:12:44.290778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.290767 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:12:44.293359 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.293341 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:12:44.293449 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.293371 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:12:44.293449 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.293382 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:12:44.293836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.293825 2557 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 16 00:12:44.293836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.293831 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:12:44.293953 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.293834 2557 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 16 00:12:44.293953 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.293891 2557 state_mem.go:36] "Initialized new in-memory state store" Jul 16 00:12:44.294526 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.294510 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:12:44.294610 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.294542 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:12:44.294610 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.294557 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:12:44.295175 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.295100 2557 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-255.ec2.internal.18c29cc321e51fb7 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-255.ec2.internal,UID:ip-10-0-131-255.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-255.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-255.ec2.internal,},FirstTimestamp:2026-07-16 00:12:44.293357495 +0000 UTC m=+0.361220775,LastTimestamp:2026-07-16 00:12:44.293357495 +0000 UTC m=+0.361220775,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-255.ec2.internal,}" Jul 16 00:12:44.296108 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.296093 2557 policy_none.go:49] "None policy: Start" Jul 16 00:12:44.296152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.296115 2557 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 16 00:12:44.296152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.296129 2557 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 16 00:12:44.297411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.297397 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-kbhzf" Jul 16 00:12:44.298141 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.298129 2557 policy_none.go:47] "Start" Jul 16 00:12:44.330518 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.330503 2557 manager.go:337] "Starting Device Plugin manager" Jul 16 00:12:44.330617 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.330540 2557 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 16 00:12:44.330617 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.330553 2557 server.go:87] "Starting device plugin registration server" Jul 16 00:12:44.330809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.330796 2557 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 16 00:12:44.330863 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.330812 2557 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 16 00:12:44.330930 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.330913 2557 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 16 00:12:44.331037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.331001 2557 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 16 00:12:44.331037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.331010 2557 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 16 00:12:44.331494 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.331477 2557 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 16 00:12:44.331558 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.331519 2557 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.374740 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.374704 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 16 00:12:44.382196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.375878 2557 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 16 00:12:44.382196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.375913 2557 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 16 00:12:44.382196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.375934 2557 kubelet.go:2448] "Starting kubelet main sync loop" Jul 16 00:12:44.382196 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.375988 2557 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 16 00:12:44.382196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.378122 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:12:44.431105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.431071 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:12:44.432136 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.432121 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:12:44.432227 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.432155 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:12:44.432227 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.432165 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:12:44.432227 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.432188 2557 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.441118 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.441101 2557 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.441194 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.441123 2557 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-255.ec2.internal\": node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.467309 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.467244 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.476459 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.476435 2557 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal"] Jul 16 00:12:44.476516 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.476498 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:12:44.478170 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.478156 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:12:44.478249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.478183 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:12:44.478249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.478197 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:12:44.480561 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.480548 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:12:44.480683 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.480668 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.480745 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.480703 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:12:44.481272 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.481257 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:12:44.481350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.481283 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:12:44.481350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.481293 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:12:44.481350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.481257 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:12:44.481436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.481356 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:12:44.481436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.481368 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:12:44.483556 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.483538 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.483651 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.483563 2557 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 16 00:12:44.484243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.484221 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientMemory" Jul 16 00:12:44.484320 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.484253 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasNoDiskPressure" Jul 16 00:12:44.484320 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.484266 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeHasSufficientPID" Jul 16 00:12:44.507551 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.507531 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-255.ec2.internal\" not found" node="ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.510855 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.510837 2557 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-255.ec2.internal\" not found" node="ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.567978 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.567938 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.576344 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.576311 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38082aa6ed7e2d8aef36fbf429f78a18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal\" (UID: \"38082aa6ed7e2d8aef36fbf429f78a18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.576474 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.576348 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38082aa6ed7e2d8aef36fbf429f78a18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal\" (UID: \"38082aa6ed7e2d8aef36fbf429f78a18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.576474 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.576369 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/091fefe17ee534afe3f758c9b12630fb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-255.ec2.internal\" (UID: \"091fefe17ee534afe3f758c9b12630fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.668513 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.668468 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.676892 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.676867 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38082aa6ed7e2d8aef36fbf429f78a18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal\" (UID: \"38082aa6ed7e2d8aef36fbf429f78a18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.677064 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.676898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38082aa6ed7e2d8aef36fbf429f78a18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal\" (UID: \"38082aa6ed7e2d8aef36fbf429f78a18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.677064 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.676916 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/091fefe17ee534afe3f758c9b12630fb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-255.ec2.internal\" (UID: \"091fefe17ee534afe3f758c9b12630fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.677064 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.676959 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/38082aa6ed7e2d8aef36fbf429f78a18-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal\" (UID: \"38082aa6ed7e2d8aef36fbf429f78a18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.677064 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.677033 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/091fefe17ee534afe3f758c9b12630fb-config\") pod \"kube-apiserver-proxy-ip-10-0-131-255.ec2.internal\" (UID: \"091fefe17ee534afe3f758c9b12630fb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.677185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.677066 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/38082aa6ed7e2d8aef36fbf429f78a18-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal\" (UID: \"38082aa6ed7e2d8aef36fbf429f78a18\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.779052 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.779023 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.810244 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.810213 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.813857 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:44.813835 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" Jul 16 00:12:44.879354 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.879320 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:44.979774 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:44.979740 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:45.080249 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.080171 2557 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-255.ec2.internal\" not found" Jul 16 00:12:45.171700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.171669 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:12:45.173455 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.173436 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" Jul 16 00:12:45.185842 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.185821 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:12:45.187628 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.187615 2557 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" Jul 16 00:12:45.198747 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.198734 2557 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 16 00:12:45.214878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.214855 2557 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 16 00:12:45.214997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.214980 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 00:12:45.215054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.215014 2557 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 16 00:12:45.241939 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.241917 2557 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:12:45.256109 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.256092 2557 apiserver.go:52] "Watching apiserver" Jul 16 00:12:45.263313 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.263285 2557 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 16 00:12:45.263624 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.263602 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-clfwg","kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww","openshift-cluster-node-tuning-operator/tuned-8d4v6","openshift-dns/node-resolver-p4s2z","openshift-multus/multus-p8gxj","openshift-multus/network-metrics-daemon-lf7sl","openshift-network-diagnostics/network-check-target-6t5jv","openshift-ovn-kubernetes/ovnkube-node-wvknh","kube-system/global-pull-secret-syncer-92z4p","kube-system/konnectivity-agent-7sjtn","openshift-image-registry/node-ca-ln44r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal","openshift-multus/multus-additional-cni-plugins-stns6"] Jul 16 00:12:45.266070 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.266047 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:45.266139 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.266122 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:12:45.268197 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.268173 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.270339 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.270317 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.270988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.270809 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 16 00:12:45.270988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.270824 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7bsb2\"" Jul 16 00:12:45.270988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.270811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 16 00:12:45.272456 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.272440 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.272717 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.272701 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 16 00:12:45.272822 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.272808 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 16 00:12:45.273033 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.273018 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8b47d\"" Jul 16 00:12:45.273088 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.273065 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 16 00:12:45.273697 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.273676 2557 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 16 00:12:45.274510 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.274489 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.274907 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.274881 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7ldqc\"" Jul 16 00:12:45.275012 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.274926 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 16 00:12:45.275012 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.274932 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:12:45.276719 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.276701 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-5vsg4\"" Jul 16 00:12:45.276989 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.276953 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.277203 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.277095 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 16 00:12:45.277285 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.277268 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 16 00:12:45.279023 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.279006 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.279473 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.279457 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 16 00:12:45.279558 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.279476 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rlsk2\"" Jul 16 00:12:45.279619 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.279596 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 16 00:12:45.279670 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.279658 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 16 00:12:45.279721 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.279699 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 16 00:12:45.281201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281182 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-var-lib-kubelet\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281274 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281214 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysctl-d\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281274 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d617bf3a-d495-485e-911d-8d2d7fb978d1-hosts-file\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.281358 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjr7z\" (UniqueName: \"kubernetes.io/projected/d617bf3a-d495-485e-911d-8d2d7fb978d1-kube-api-access-sjr7z\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.281358 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281305 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:45.281358 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281340 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-kubernetes\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281358 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281350 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.281521 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281363 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-systemd\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281521 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281424 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-registration-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.281521 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281453 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-device-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.281521 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281477 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-tuned\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281537 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.281700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281585 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-etc-selinux\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.281700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281632 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-sys\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281676 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-host\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281706 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6t88\" (UniqueName: \"kubernetes.io/projected/4bc84f00-ab03-425a-8e68-1d1a7c515fea-kube-api-access-b6t88\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281729 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281735 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281732 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/557c760c-f5bb-4e10-a5ea-df6daebb5c45-agent-certs\") pod \"konnectivity-agent-7sjtn\" (UID: \"557c760c-f5bb-4e10-a5ea-df6daebb5c45\") " pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281773 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-kwf57\"" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281783 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281793 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281775 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-sys-fs\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.281878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281880 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc7qv\" (UniqueName: \"kubernetes.io/projected/7895e090-ae54-4835-a8f8-782ca5c8ff78-kube-api-access-mc7qv\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281902 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-lib-modules\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281925 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/557c760c-f5bb-4e10-a5ea-df6daebb5c45-konnectivity-ca\") pod \"konnectivity-agent-7sjtn\" (UID: \"557c760c-f5bb-4e10-a5ea-df6daebb5c45\") " pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281947 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bc84f00-ab03-425a-8e68-1d1a7c515fea-tmp\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.281989 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-socket-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282010 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-modprobe-d\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282028 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-run\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282050 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d617bf3a-d495-485e-911d-8d2d7fb978d1-tmp-dir\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282073 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdtjx\" (UniqueName: \"kubernetes.io/projected/60590034-ae94-403d-8bcd-0092f90dbbfe-kube-api-access-wdtjx\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282094 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysconfig\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282117 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysctl-conf\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.282284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282269 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 16 00:12:45.282692 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.282268 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 16 00:12:45.283646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.283632 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:45.283719 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.283684 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:45.284095 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.284082 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 16 00:12:45.284252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.284238 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 16 00:12:45.284305 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.284262 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vvsfj\"" Jul 16 00:12:45.285905 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.285887 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.286024 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.285957 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:45.288205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.288182 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.291878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.291853 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:12:45.292041 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.291897 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7rf4t\"" Jul 16 00:12:45.292041 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.291952 2557 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 16 00:12:45.292041 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.291991 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 16 00:12:45.292338 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.292301 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 16 00:12:45.292431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.292371 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.294762 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.294731 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 16 00:12:45.294856 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.294733 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-62xmd\"" Jul 16 00:12:45.294856 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.294832 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 16 00:12:45.295029 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.294866 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 16 00:12:45.301976 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.301919 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-15 00:07:44 +0000 UTC" deadline="2027-12-11 03:10:51.020176521 +0000 UTC" Jul 16 00:12:45.301976 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.301972 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12314h58m5.718221727s" Jul 16 00:12:45.310802 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.310783 2557 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-4drjd" Jul 16 00:12:45.321304 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.321282 2557 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-4drjd" Jul 16 00:12:45.374828 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.374807 2557 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 16 00:12:45.382823 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.382795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-lib-modules\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.382915 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.382840 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-system-cni-dir\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.383052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.382955 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-lib-modules\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.382991 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-system-cni-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.383052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383019 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbmnb\" (UniqueName: \"kubernetes.io/projected/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-kube-api-access-bbmnb\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.383052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383037 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-node-log\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/557c760c-f5bb-4e10-a5ea-df6daebb5c45-konnectivity-ca\") pod \"konnectivity-agent-7sjtn\" (UID: \"557c760c-f5bb-4e10-a5ea-df6daebb5c45\") " pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bc84f00-ab03-425a-8e68-1d1a7c515fea-tmp\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383093 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-os-release\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383114 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-systemd-units\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383135 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-etc-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383156 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-cni-netd\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovnkube-config\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383196 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-env-overrides\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383224 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-socket-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.383259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383247 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-run\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383360 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-socket-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.383579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383393 2557 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 16 00:12:45.383579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383438 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-run\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.383579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383486 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-dbus\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.383579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383511 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-slash\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383571 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-run-netns\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383604 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ca4746c-8f39-4123-bf25-94c45983d05f-host-slash\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383618 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/557c760c-f5bb-4e10-a5ea-df6daebb5c45-konnectivity-ca\") pod \"konnectivity-agent-7sjtn\" (UID: \"557c760c-f5bb-4e10-a5ea-df6daebb5c45\") " pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383632 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdtjx\" (UniqueName: \"kubernetes.io/projected/60590034-ae94-403d-8bcd-0092f90dbbfe-kube-api-access-wdtjx\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383658 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysconfig\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383682 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysctl-conf\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383701 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-var-lib-kubelet\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383721 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-cnibin\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383752 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-socket-dir-parent\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383778 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-cni-multus\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383802 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysctl-d\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383846 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d617bf3a-d495-485e-911d-8d2d7fb978d1-hosts-file\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383858 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysconfig\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.383873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjr7z\" (UniqueName: \"kubernetes.io/projected/d617bf3a-d495-485e-911d-8d2d7fb978d1-kube-api-access-sjr7z\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383892 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383915 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-var-lib-kubelet\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383915 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grn86\" (UniqueName: \"kubernetes.io/projected/8b6df3a6-3d16-4cce-8eec-bec871402de0-kube-api-access-grn86\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383952 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-cni-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383992 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-kubelet\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384016 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-log-socket\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384045 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384056 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysctl-d\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.383823 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-sysctl-conf\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384125 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d617bf3a-d495-485e-911d-8d2d7fb978d1-hosts-file\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384068 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384194 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.384205 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovnkube-script-lib\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384252 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8711c01b-c938-4538-8c1d-608395be7031-host\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.384395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.384325 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:12:45.884289532 +0000 UTC m=+1.952152817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384357 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-device-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384427 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-cni-bin\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384446 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-device-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384475 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384515 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-host\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384551 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6t88\" (UniqueName: \"kubernetes.io/projected/4bc84f00-ab03-425a-8e68-1d1a7c515fea-kube-api-access-b6t88\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384557 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384591 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-host\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384633 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ca4746c-8f39-4123-bf25-94c45983d05f-iptables-alerter-script\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384661 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8711c01b-c938-4538-8c1d-608395be7031-serviceca\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfnzm\" (UniqueName: \"kubernetes.io/projected/8711c01b-c938-4538-8c1d-608395be7031-kube-api-access-zfnzm\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384709 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384733 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-netns\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384748 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b9mr\" (UniqueName: \"kubernetes.io/projected/0ca4746c-8f39-4123-bf25-94c45983d05f-kube-api-access-7b9mr\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384777 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-modprobe-d\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.385284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d617bf3a-d495-485e-911d-8d2d7fb978d1-tmp-dir\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384810 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-k8s-cni-cncf-io\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384833 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-kubelet\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384852 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-etc-kubernetes\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384872 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-os-release\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-cni-binary-copy\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384899 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-modprobe-d\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-ovn\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384955 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-kubernetes\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.384995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-systemd\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385014 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-kubernetes\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385023 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-cni-binary-copy\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385035 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-systemd\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385049 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-hostroot\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385072 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-multus-certs\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-var-lib-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385102 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d617bf3a-d495-485e-911d-8d2d7fb978d1-tmp-dir\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.386174 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-registration-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385179 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-tuned\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385202 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-systemd\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385215 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-registration-dir\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385226 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovn-node-metrics-cert\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65mmr\" (UniqueName: \"kubernetes.io/projected/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-kube-api-access-65mmr\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-etc-selinux\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-sys\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385345 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-kubelet-config\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385370 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-etc-selinux\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385367 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-cnibin\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385410 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bc84f00-ab03-425a-8e68-1d1a7c515fea-sys\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385413 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-cni-bin\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385460 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-conf-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385484 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-daemon-config\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385507 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/557c760c-f5bb-4e10-a5ea-df6daebb5c45-agent-certs\") pod \"konnectivity-agent-7sjtn\" (UID: \"557c760c-f5bb-4e10-a5ea-df6daebb5c45\") " pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.386682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385558 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-sys-fs\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.387222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385613 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7895e090-ae54-4835-a8f8-782ca5c8ff78-sys-fs\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.387222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.385709 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc7qv\" (UniqueName: \"kubernetes.io/projected/7895e090-ae54-4835-a8f8-782ca5c8ff78-kube-api-access-mc7qv\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.387222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.386566 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bc84f00-ab03-425a-8e68-1d1a7c515fea-tmp\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.387222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.387116 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bc84f00-ab03-425a-8e68-1d1a7c515fea-etc-tuned\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.387613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.387583 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/557c760c-f5bb-4e10-a5ea-df6daebb5c45-agent-certs\") pod \"konnectivity-agent-7sjtn\" (UID: \"557c760c-f5bb-4e10-a5ea-df6daebb5c45\") " pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.395737 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.395711 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjr7z\" (UniqueName: \"kubernetes.io/projected/d617bf3a-d495-485e-911d-8d2d7fb978d1-kube-api-access-sjr7z\") pod \"node-resolver-p4s2z\" (UID: \"d617bf3a-d495-485e-911d-8d2d7fb978d1\") " pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.395920 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.395902 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdtjx\" (UniqueName: \"kubernetes.io/projected/60590034-ae94-403d-8bcd-0092f90dbbfe-kube-api-access-wdtjx\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:45.396291 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.396273 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6t88\" (UniqueName: \"kubernetes.io/projected/4bc84f00-ab03-425a-8e68-1d1a7c515fea-kube-api-access-b6t88\") pod \"tuned-8d4v6\" (UID: \"4bc84f00-ab03-425a-8e68-1d1a7c515fea\") " pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.396429 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.396408 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc7qv\" (UniqueName: \"kubernetes.io/projected/7895e090-ae54-4835-a8f8-782ca5c8ff78-kube-api-access-mc7qv\") pod \"aws-ebs-csi-driver-node-2jpww\" (UID: \"7895e090-ae54-4835-a8f8-782ca5c8ff78\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.397122 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.397101 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod091fefe17ee534afe3f758c9b12630fb.slice/crio-81f51fcea7b9a2396c9e15a7aae81971ffbc3bf5dd69985811659e6ce0a03265 WatchSource:0}: Error finding container 81f51fcea7b9a2396c9e15a7aae81971ffbc3bf5dd69985811659e6ce0a03265: Status 404 returned error can't find the container with id 81f51fcea7b9a2396c9e15a7aae81971ffbc3bf5dd69985811659e6ce0a03265 Jul 16 00:12:45.397652 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.397636 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38082aa6ed7e2d8aef36fbf429f78a18.slice/crio-97e7fb97aee5ef9b0f4f264cc1d8059c8ccdc5e30d2e64b3e4881fed5883e949 WatchSource:0}: Error finding container 97e7fb97aee5ef9b0f4f264cc1d8059c8ccdc5e30d2e64b3e4881fed5883e949: Status 404 returned error can't find the container with id 97e7fb97aee5ef9b0f4f264cc1d8059c8ccdc5e30d2e64b3e4881fed5883e949 Jul 16 00:12:45.402306 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.402291 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:12:45.485946 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.485918 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ca4746c-8f39-4123-bf25-94c45983d05f-iptables-alerter-script\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.485946 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.485946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8711c01b-c938-4538-8c1d-608395be7031-serviceca\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.486177 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.485977 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfnzm\" (UniqueName: \"kubernetes.io/projected/8711c01b-c938-4538-8c1d-608395be7031-kube-api-access-zfnzm\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.486177 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486001 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:45.486177 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486165 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-netns\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486296 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486196 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b9mr\" (UniqueName: \"kubernetes.io/projected/0ca4746c-8f39-4123-bf25-94c45983d05f-kube-api-access-7b9mr\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.486296 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486238 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-netns\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486296 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486270 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-k8s-cni-cncf-io\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486381 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-kubelet\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486381 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-etc-kubernetes\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486381 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486324 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-k8s-cni-cncf-io\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486381 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486343 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-os-release\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486381 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486366 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-cni-binary-copy\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486381 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486375 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-kubelet\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-ovn\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486408 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-etc-kubernetes\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486424 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-ovn\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486431 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-os-release\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486531 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-cni-binary-copy\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486553 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-hostroot\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486574 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-multus-certs\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486589 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-var-lib-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.486613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486604 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-systemd\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486619 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovn-node-metrics-cert\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486637 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-hostroot\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486656 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-var-lib-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486690 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-run-multus-certs\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486697 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-systemd\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486728 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65mmr\" (UniqueName: \"kubernetes.io/projected/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-kube-api-access-65mmr\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486764 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-kubelet-config\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486787 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-cnibin\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486811 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-cni-bin\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486836 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-conf-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486855 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-cnibin\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-daemon-config\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486870 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-cni-bin\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486932 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-conf-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486946 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-cni-binary-copy\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486950 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-kubelet-config\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.486994 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-cni-binary-copy\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.487107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487090 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487158 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0ca4746c-8f39-4123-bf25-94c45983d05f-iptables-alerter-script\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487232 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8711c01b-c938-4538-8c1d-608395be7031-serviceca\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487346 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-daemon-config\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-run-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-system-cni-dir\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487590 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-system-cni-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbmnb\" (UniqueName: \"kubernetes.io/projected/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-kube-api-access-bbmnb\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487639 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-node-log\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487641 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-system-cni-dir\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487680 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-os-release\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487692 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-node-log\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487712 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-systemd-units\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487715 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-system-cni-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487735 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-etc-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487737 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-os-release\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487769 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-systemd-units\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.487848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487788 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-etc-openvswitch\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-cni-netd\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487820 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-cni-netd\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487825 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovnkube-config\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487861 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-env-overrides\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487879 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-dbus\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487913 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-slash\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487933 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-run-netns\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487949 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ca4746c-8f39-4123-bf25-94c45983d05f-host-slash\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.487985 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-cnibin\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488008 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-socket-dir-parent\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488025 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-run-netns\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488047 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0ca4746c-8f39-4123-bf25-94c45983d05f-host-slash\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488066 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-cni-multus\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488092 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-slash\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488095 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-cnibin\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.488611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-dbus\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488123 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-socket-dir-parent\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488031 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-host-var-lib-cni-multus\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488174 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488252 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grn86\" (UniqueName: \"kubernetes.io/projected/8b6df3a6-3d16-4cce-8eec-bec871402de0-kube-api-access-grn86\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488249 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-run-ovn-kubernetes\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488297 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-cni-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488324 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-kubelet\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488349 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-log-socket\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488357 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488369 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b6df3a6-3d16-4cce-8eec-bec871402de0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488389 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488406 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-multus-cni-dir\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488416 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488424 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-kubelet\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488446 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovnkube-script-lib\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488419 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-log-socket\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488452 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488470 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8711c01b-c938-4538-8c1d-608395be7031-host\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488447 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovnkube-config\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.488508 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488527 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8711c01b-c938-4538-8c1d-608395be7031-host\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488541 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-cni-bin\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488574 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-host-cni-bin\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.488578 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret podName:a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0 nodeName:}" failed. No retries permitted until 2026-07-16 00:12:45.988560986 +0000 UTC m=+2.056424271 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret") pod "global-pull-secret-syncer-92z4p" (UID: "a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488815 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-env-overrides\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488904 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovnkube-script-lib\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.488988 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b6df3a6-3d16-4cce-8eec-bec871402de0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.489557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.489159 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-ovn-node-metrics-cert\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.489896 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.489713 2557 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:12:45.494688 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.494666 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:12:45.494784 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.494692 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:12:45.494784 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.494707 2557 projected.go:196] Error preparing data for projected volume kube-api-access-qqlnz for pod openshift-network-diagnostics/network-check-target-6t5jv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:45.494784 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.494780 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz podName:0e11e69e-30aa-431f-8718-a4696c6007cd nodeName:}" failed. No retries permitted until 2026-07-16 00:12:45.994761926 +0000 UTC m=+2.062625205 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qqlnz" (UniqueName: "kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz") pod "network-check-target-6t5jv" (UID: "0e11e69e-30aa-431f-8718-a4696c6007cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:45.495806 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.495788 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfnzm\" (UniqueName: \"kubernetes.io/projected/8711c01b-c938-4538-8c1d-608395be7031-kube-api-access-zfnzm\") pod \"node-ca-ln44r\" (UID: \"8711c01b-c938-4538-8c1d-608395be7031\") " pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.495909 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.495897 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-65mmr\" (UniqueName: \"kubernetes.io/projected/d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870-kube-api-access-65mmr\") pod \"ovnkube-node-wvknh\" (UID: \"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870\") " pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.496228 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.496208 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbmnb\" (UniqueName: \"kubernetes.io/projected/f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a-kube-api-access-bbmnb\") pod \"multus-p8gxj\" (UID: \"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a\") " pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.496298 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.496284 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b9mr\" (UniqueName: \"kubernetes.io/projected/0ca4746c-8f39-4123-bf25-94c45983d05f-kube-api-access-7b9mr\") pod \"iptables-alerter-clfwg\" (UID: \"0ca4746c-8f39-4123-bf25-94c45983d05f\") " pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.497163 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.497148 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grn86\" (UniqueName: \"kubernetes.io/projected/8b6df3a6-3d16-4cce-8eec-bec871402de0-kube-api-access-grn86\") pod \"multus-additional-cni-plugins-stns6\" (UID: \"8b6df3a6-3d16-4cce-8eec-bec871402de0\") " pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.603497 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.603423 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:12:45.613492 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.613466 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557c760c_f5bb_4e10_a5ea_df6daebb5c45.slice/crio-2bcb01963afb06d58f65daa9bc1c68eda4e683c3fe308af45a1ede7f18b8d37f WatchSource:0}: Error finding container 2bcb01963afb06d58f65daa9bc1c68eda4e683c3fe308af45a1ede7f18b8d37f: Status 404 returned error can't find the container with id 2bcb01963afb06d58f65daa9bc1c68eda4e683c3fe308af45a1ede7f18b8d37f Jul 16 00:12:45.616399 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.616383 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" Jul 16 00:12:45.623159 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.623145 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" Jul 16 00:12:45.623786 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.623767 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7895e090_ae54_4835_a8f8_782ca5c8ff78.slice/crio-f7b5b5ad5e6a19a6042f4690b934689bd4beb11301039bf157d405eb7213da54 WatchSource:0}: Error finding container f7b5b5ad5e6a19a6042f4690b934689bd4beb11301039bf157d405eb7213da54: Status 404 returned error can't find the container with id f7b5b5ad5e6a19a6042f4690b934689bd4beb11301039bf157d405eb7213da54 Jul 16 00:12:45.631111 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.631091 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc84f00_ab03_425a_8e68_1d1a7c515fea.slice/crio-887fa416d32e0e6fb60de75090508c8e4e86e9e13abc1235691ca2dfe774cf45 WatchSource:0}: Error finding container 887fa416d32e0e6fb60de75090508c8e4e86e9e13abc1235691ca2dfe774cf45: Status 404 returned error can't find the container with id 887fa416d32e0e6fb60de75090508c8e4e86e9e13abc1235691ca2dfe774cf45 Jul 16 00:12:45.638600 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.638579 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-p4s2z" Jul 16 00:12:45.647920 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.647899 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd617bf3a_d495_485e_911d_8d2d7fb978d1.slice/crio-71a2cb63337ffcaa9aae5e43bfba33f6fab6db3fd7aca88bfa6fcbeeb70a496e WatchSource:0}: Error finding container 71a2cb63337ffcaa9aae5e43bfba33f6fab6db3fd7aca88bfa6fcbeeb70a496e: Status 404 returned error can't find the container with id 71a2cb63337ffcaa9aae5e43bfba33f6fab6db3fd7aca88bfa6fcbeeb70a496e Jul 16 00:12:45.655306 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.655286 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-p8gxj" Jul 16 00:12:45.664023 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.663998 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0a0ee7e_5f33_4cdb_b5a9_05a0530ccc7a.slice/crio-f3e31bbdcc24bc81417faee4d68a28d627e66f37990f73520477ff2d0c24abeb WatchSource:0}: Error finding container f3e31bbdcc24bc81417faee4d68a28d627e66f37990f73520477ff2d0c24abeb: Status 404 returned error can't find the container with id f3e31bbdcc24bc81417faee4d68a28d627e66f37990f73520477ff2d0c24abeb Jul 16 00:12:45.673775 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.673758 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:12:45.681131 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.681109 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3ddd0bd_27bf_4f8c_bdc2_ae4b8c0aa870.slice/crio-a1651f35aa103a95bcdac5edfcdd202409168c59403cccfb62832e7fd311df8e WatchSource:0}: Error finding container a1651f35aa103a95bcdac5edfcdd202409168c59403cccfb62832e7fd311df8e: Status 404 returned error can't find the container with id a1651f35aa103a95bcdac5edfcdd202409168c59403cccfb62832e7fd311df8e Jul 16 00:12:45.696362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.696344 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-stns6" Jul 16 00:12:45.703649 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.703629 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b6df3a6_3d16_4cce_8eec_bec871402de0.slice/crio-37a3b3193b07cf27d3b369a0dd359f1f63bcf921263f2bf66be01b15339a4c13 WatchSource:0}: Error finding container 37a3b3193b07cf27d3b369a0dd359f1f63bcf921263f2bf66be01b15339a4c13: Status 404 returned error can't find the container with id 37a3b3193b07cf27d3b369a0dd359f1f63bcf921263f2bf66be01b15339a4c13 Jul 16 00:12:45.707048 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.707033 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-clfwg" Jul 16 00:12:45.711586 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.711572 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ln44r" Jul 16 00:12:45.715815 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.715797 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ca4746c_8f39_4123_bf25_94c45983d05f.slice/crio-b5e144776da1b6461e537295e519f4e6df5a6e1ca6a5167fc5920b5ef1ed8759 WatchSource:0}: Error finding container b5e144776da1b6461e537295e519f4e6df5a6e1ca6a5167fc5920b5ef1ed8759: Status 404 returned error can't find the container with id b5e144776da1b6461e537295e519f4e6df5a6e1ca6a5167fc5920b5ef1ed8759 Jul 16 00:12:45.719757 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:12:45.719734 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8711c01b_c938_4538_8c1d_608395be7031.slice/crio-b6d0dd66fc5011f5b10a6dd10c085138442a472b8b39bf739d5ab223d54c984a WatchSource:0}: Error finding container b6d0dd66fc5011f5b10a6dd10c085138442a472b8b39bf739d5ab223d54c984a: Status 404 returned error can't find the container with id b6d0dd66fc5011f5b10a6dd10c085138442a472b8b39bf739d5ab223d54c984a Jul 16 00:12:45.892212 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.892133 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:45.892348 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.892258 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:45.892348 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.892303 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:12:46.892290542 +0000 UTC m=+2.960153809 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:45.992600 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:45.992553 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:45.992767 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.992706 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:45.992767 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:45.992763 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret podName:a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0 nodeName:}" failed. No retries permitted until 2026-07-16 00:12:46.992745414 +0000 UTC m=+3.060608685 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret") pod "global-pull-secret-syncer-92z4p" (UID: "a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:46.093107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.093027 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:46.093284 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:46.093174 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:12:46.093284 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:46.093199 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:12:46.093284 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:46.093212 2557 projected.go:196] Error preparing data for projected volume kube-api-access-qqlnz for pod openshift-network-diagnostics/network-check-target-6t5jv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:46.093284 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:46.093278 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz podName:0e11e69e-30aa-431f-8718-a4696c6007cd nodeName:}" failed. No retries permitted until 2026-07-16 00:12:47.093257969 +0000 UTC m=+3.161121252 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qqlnz" (UniqueName: "kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz") pod "network-check-target-6t5jv" (UID: "0e11e69e-30aa-431f-8718-a4696c6007cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:46.289331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.289301 2557 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:12:46.324723 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.324684 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:07:45 +0000 UTC" deadline="2028-02-16 07:59:13.934620742 +0000 UTC" Jul 16 00:12:46.324723 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.324721 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13927h46m27.609904259s" Jul 16 00:12:46.413809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.413698 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4s2z" event={"ID":"d617bf3a-d495-485e-911d-8d2d7fb978d1","Type":"ContainerStarted","Data":"71a2cb63337ffcaa9aae5e43bfba33f6fab6db3fd7aca88bfa6fcbeeb70a496e"} Jul 16 00:12:46.428525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.428442 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" event={"ID":"7895e090-ae54-4835-a8f8-782ca5c8ff78","Type":"ContainerStarted","Data":"f7b5b5ad5e6a19a6042f4690b934689bd4beb11301039bf157d405eb7213da54"} Jul 16 00:12:46.439501 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.439465 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7sjtn" event={"ID":"557c760c-f5bb-4e10-a5ea-df6daebb5c45","Type":"ContainerStarted","Data":"2bcb01963afb06d58f65daa9bc1c68eda4e683c3fe308af45a1ede7f18b8d37f"} Jul 16 00:12:46.450474 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.450391 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" event={"ID":"091fefe17ee534afe3f758c9b12630fb","Type":"ContainerStarted","Data":"81f51fcea7b9a2396c9e15a7aae81971ffbc3bf5dd69985811659e6ce0a03265"} Jul 16 00:12:46.465049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.465018 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-clfwg" event={"ID":"0ca4746c-8f39-4123-bf25-94c45983d05f","Type":"ContainerStarted","Data":"b5e144776da1b6461e537295e519f4e6df5a6e1ca6a5167fc5920b5ef1ed8759"} Jul 16 00:12:46.473332 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.473306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerStarted","Data":"37a3b3193b07cf27d3b369a0dd359f1f63bcf921263f2bf66be01b15339a4c13"} Jul 16 00:12:46.486621 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.486512 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"a1651f35aa103a95bcdac5edfcdd202409168c59403cccfb62832e7fd311df8e"} Jul 16 00:12:46.494394 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.494371 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p8gxj" event={"ID":"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a","Type":"ContainerStarted","Data":"f3e31bbdcc24bc81417faee4d68a28d627e66f37990f73520477ff2d0c24abeb"} Jul 16 00:12:46.509466 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.509392 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" event={"ID":"4bc84f00-ab03-425a-8e68-1d1a7c515fea","Type":"ContainerStarted","Data":"887fa416d32e0e6fb60de75090508c8e4e86e9e13abc1235691ca2dfe774cf45"} Jul 16 00:12:46.515680 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.515653 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" event={"ID":"38082aa6ed7e2d8aef36fbf429f78a18","Type":"ContainerStarted","Data":"97e7fb97aee5ef9b0f4f264cc1d8059c8ccdc5e30d2e64b3e4881fed5883e949"} Jul 16 00:12:46.518856 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.518831 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ln44r" event={"ID":"8711c01b-c938-4538-8c1d-608395be7031","Type":"ContainerStarted","Data":"b6d0dd66fc5011f5b10a6dd10c085138442a472b8b39bf739d5ab223d54c984a"} Jul 16 00:12:46.899525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:46.899486 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:46.899718 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:46.899651 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:46.899718 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:46.899713 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:12:48.899695571 +0000 UTC m=+4.967558842 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:47.000524 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.000484 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:47.000716 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.000625 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:47.000771 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.000690 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret podName:a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0 nodeName:}" failed. No retries permitted until 2026-07-16 00:12:49.00067284 +0000 UTC m=+5.068536147 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret") pod "global-pull-secret-syncer-92z4p" (UID: "a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:47.101379 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.101345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:47.101553 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.101517 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:12:47.101553 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.101542 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:12:47.101553 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.101554 2557 projected.go:196] Error preparing data for projected volume kube-api-access-qqlnz for pod openshift-network-diagnostics/network-check-target-6t5jv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:47.101700 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.101618 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz podName:0e11e69e-30aa-431f-8718-a4696c6007cd nodeName:}" failed. No retries permitted until 2026-07-16 00:12:49.101598737 +0000 UTC m=+5.169462016 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qqlnz" (UniqueName: "kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz") pod "network-check-target-6t5jv" (UID: "0e11e69e-30aa-431f-8718-a4696c6007cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:47.325319 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.325210 2557 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-15 00:07:45 +0000 UTC" deadline="2028-04-22 02:26:56.469441042 +0000 UTC" Jul 16 00:12:47.325319 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.325280 2557 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15506h14m9.144165822s" Jul 16 00:12:47.377262 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.376447 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:47.377262 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.376578 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:47.377262 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.376666 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:47.377262 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.376748 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:12:47.377262 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.376805 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:47.377262 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:47.376870 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:47.796447 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:47.796414 2557 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 16 00:12:48.922808 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:48.922259 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:48.922808 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:48.922411 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:48.922808 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:48.922473 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:12:52.92245412 +0000 UTC m=+8.990317392 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:49.023839 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:49.023204 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:49.023839 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.023352 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:49.023839 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.023429 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret podName:a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0 nodeName:}" failed. No retries permitted until 2026-07-16 00:12:53.023408455 +0000 UTC m=+9.091271722 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret") pod "global-pull-secret-syncer-92z4p" (UID: "a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:49.124415 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:49.124372 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:49.124578 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.124555 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:12:49.124632 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.124591 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:12:49.124632 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.124605 2557 projected.go:196] Error preparing data for projected volume kube-api-access-qqlnz for pod openshift-network-diagnostics/network-check-target-6t5jv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:49.124735 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.124671 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz podName:0e11e69e-30aa-431f-8718-a4696c6007cd nodeName:}" failed. No retries permitted until 2026-07-16 00:12:53.124651812 +0000 UTC m=+9.192515102 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qqlnz" (UniqueName: "kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz") pod "network-check-target-6t5jv" (UID: "0e11e69e-30aa-431f-8718-a4696c6007cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:49.377150 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:49.377115 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:49.377321 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.377252 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:49.377321 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:49.377312 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:49.377441 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.377377 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:49.377441 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:49.377419 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:49.377532 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:49.377490 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:12:51.376817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:51.376780 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:51.377282 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:51.376931 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:12:51.377282 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:51.376948 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:51.377282 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:51.377050 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:51.377282 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:51.377093 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:51.377282 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:51.377150 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:52.956861 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:52.956622 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:52.957324 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:52.956797 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:52.957324 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:52.957006 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:13:00.956981361 +0000 UTC m=+17.024844640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:12:53.057874 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:53.057753 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:53.058047 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.057884 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:53.058047 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.057946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret podName:a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:01.057928281 +0000 UTC m=+17.125791553 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret") pod "global-pull-secret-syncer-92z4p" (UID: "a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:12:53.158203 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:53.158136 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:53.158383 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.158323 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:12:53.158383 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.158343 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:12:53.158383 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.158357 2557 projected.go:196] Error preparing data for projected volume kube-api-access-qqlnz for pod openshift-network-diagnostics/network-check-target-6t5jv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:53.158522 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.158414 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz podName:0e11e69e-30aa-431f-8718-a4696c6007cd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:01.158397521 +0000 UTC m=+17.226260791 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qqlnz" (UniqueName: "kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz") pod "network-check-target-6t5jv" (UID: "0e11e69e-30aa-431f-8718-a4696c6007cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:12:53.376157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:53.376127 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:53.376157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:53.376155 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:53.376374 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.376253 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:53.376453 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:53.376437 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:53.376538 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.376522 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:53.376628 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:53.376606 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:12:55.377179 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:55.377083 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:55.377179 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:55.377117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:55.377179 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:55.377117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:55.377717 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:55.377231 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:55.377717 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:55.377294 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:55.377717 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:55.377386 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:12:57.376907 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:57.376868 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:57.376907 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:57.376910 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:57.377411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:57.376877 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:57.377411 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:57.377008 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:57.377411 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:57.377128 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:12:57.377411 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:57.377199 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:59.376701 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:59.376670 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:12:59.377127 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:59.376774 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:12:59.377127 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:59.376784 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:12:59.377127 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:59.376853 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:12:59.377127 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:12:59.376883 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:12:59.377127 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:12:59.377025 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:01.018679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:01.018633 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:01.019220 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.018817 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:13:01.019220 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.018902 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:13:17.018880379 +0000 UTC m=+33.086743652 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:13:01.119369 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:01.119314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:01.119540 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.119463 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:13:01.119615 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.119546 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret podName:a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:17.119527146 +0000 UTC m=+33.187390415 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret") pod "global-pull-secret-syncer-92z4p" (UID: "a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:13:01.219942 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:01.219907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:01.220105 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.220082 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:13:01.220149 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.220109 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:13:01.220149 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.220121 2557 projected.go:196] Error preparing data for projected volume kube-api-access-qqlnz for pod openshift-network-diagnostics/network-check-target-6t5jv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:13:01.220226 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.220175 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz podName:0e11e69e-30aa-431f-8718-a4696c6007cd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:17.220159951 +0000 UTC m=+33.288023235 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qqlnz" (UniqueName: "kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz") pod "network-check-target-6t5jv" (UID: "0e11e69e-30aa-431f-8718-a4696c6007cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:13:01.376403 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:01.376318 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:01.376543 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:01.376325 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:01.376543 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.376444 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:01.376635 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:01.376333 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:01.376666 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.376550 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:01.376712 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:01.376667 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:03.376867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:03.376825 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:03.377357 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:03.376823 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:03.377357 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:03.376975 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:03.377357 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:03.376832 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:03.377357 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:03.377038 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:03.377357 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:03.377111 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:05.376797 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.376713 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:05.376797 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.376764 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:05.376797 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.376764 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:05.377319 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:05.376825 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:05.377319 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:05.376975 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:05.377319 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:05.377056 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:05.570121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.570057 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" event={"ID":"091fefe17ee534afe3f758c9b12630fb","Type":"ContainerStarted","Data":"f637b7c8df2a6d80ca1c93314137f72f71c8c96abc849a25e096aceb133ccd50"} Jul 16 00:13:05.572991 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.572793 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"c7893388218e7ceb3de1632f8898c1b5f53a8c89fa98cd7e9484b76fd8c143b6"} Jul 16 00:13:05.575187 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.575163 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-p8gxj" event={"ID":"f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a","Type":"ContainerStarted","Data":"6eb796e46dea5fe895f4efe0e2e66c816c84ebeb1a02947b14b414fa92b81216"} Jul 16 00:13:05.576685 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.576664 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" event={"ID":"4bc84f00-ab03-425a-8e68-1d1a7c515fea","Type":"ContainerStarted","Data":"b6731168f9368ffef99649528fe9d24363e8eed6256d9a6fe2b6501878340659"} Jul 16 00:13:05.585189 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.585151 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-255.ec2.internal" podStartSLOduration=20.585139795 podStartE2EDuration="20.585139795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:05.584889986 +0000 UTC m=+21.652753286" watchObservedRunningTime="2026-07-16 00:13:05.585139795 +0000 UTC m=+21.653003082" Jul 16 00:13:05.616183 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.615950 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8d4v6" podStartSLOduration=2.22569119 podStartE2EDuration="21.615929459s" totalImagesPullingTime="19.390238269s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:05.600236773 +0000 UTC m=+21.668100060" watchObservedRunningTime="2026-07-16 00:13:05.615929459 +0000 UTC m=+21.683792780" Jul 16 00:13:05.616325 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:05.616181 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-p8gxj" podStartSLOduration=2.249183901 podStartE2EDuration="21.6161682s" totalImagesPullingTime="19.366984299s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:05.615753917 +0000 UTC m=+21.683617227" watchObservedRunningTime="2026-07-16 00:13:05.6161682 +0000 UTC m=+21.684031537" Jul 16 00:13:06.581112 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.580922 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:13:06.581870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.581479 2557 generic.go:356] "Generic (PLEG): container finished" podID="d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870" containerID="b4a6283916ae729880853d2ac3e656462fb010e88b754c5a9fd51d9d0e869b78" exitCode=1 Jul 16 00:13:06.581870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.581546 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"53c0be15c940067f386450a07f900fc13d52524b28befae1ba7e16b277373d38"} Jul 16 00:13:06.581870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.581624 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"90917445aa7f4adc63ed1440e9b7bef0296c60d61f64f5a832eaf9e932d9a174"} Jul 16 00:13:06.581870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.581677 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"fe90423a579d066379600411338cc68ef11a04a4bb7e88cbf3388a3b33851aa7"} Jul 16 00:13:06.581870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.581721 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"474df9cb8545300a9da689f699f1c77734f69c0288ebece00418d8f9680bdb44"} Jul 16 00:13:06.581870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.581765 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerDied","Data":"b4a6283916ae729880853d2ac3e656462fb010e88b754c5a9fd51d9d0e869b78"} Jul 16 00:13:06.582977 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.582949 2557 generic.go:356] "Generic (PLEG): container finished" podID="38082aa6ed7e2d8aef36fbf429f78a18" containerID="d8474fa3d33b125bd0859e10890bbcdf1f67dcc7fa43592dbdb3d8d372286854" exitCode=0 Jul 16 00:13:06.583090 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.582993 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" event={"ID":"38082aa6ed7e2d8aef36fbf429f78a18","Type":"ContainerDied","Data":"d8474fa3d33b125bd0859e10890bbcdf1f67dcc7fa43592dbdb3d8d372286854"} Jul 16 00:13:06.584338 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.584319 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ln44r" event={"ID":"8711c01b-c938-4538-8c1d-608395be7031","Type":"ContainerStarted","Data":"4fd9c78f377d54dac925033f92348964ac4425e5fc85ac8aa833ee5c682ec7dd"} Jul 16 00:13:06.585659 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.585638 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-p4s2z" event={"ID":"d617bf3a-d495-485e-911d-8d2d7fb978d1","Type":"ContainerStarted","Data":"20223ac2ed888250f0138a1f4e116238374158321cb5d77177d3f667f3d41f8f"} Jul 16 00:13:06.586938 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.586907 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" event={"ID":"7895e090-ae54-4835-a8f8-782ca5c8ff78","Type":"ContainerStarted","Data":"a4973e58cac0af4fa89bb781f4b0b3f5704459d9cc1ab24fd86241f2e797f37c"} Jul 16 00:13:06.588062 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.588033 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7sjtn" event={"ID":"557c760c-f5bb-4e10-a5ea-df6daebb5c45","Type":"ContainerStarted","Data":"c0522e95190a9dcdcae513fb74296581f3e556e649edab26fed0e0cdb1686959"} Jul 16 00:13:06.589215 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.589197 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-clfwg" event={"ID":"0ca4746c-8f39-4123-bf25-94c45983d05f","Type":"ContainerStarted","Data":"3074c44937727e394d2849d3175c07329b673f657f1ce35d44e466d0b44775a2"} Jul 16 00:13:06.590555 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.590537 2557 generic.go:356] "Generic (PLEG): container finished" podID="8b6df3a6-3d16-4cce-8eec-bec871402de0" containerID="1d3001debd47ea8820d1d89e650ae20489d0bd8822dac5ee2795f16146173003" exitCode=0 Jul 16 00:13:06.590630 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.590595 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerDied","Data":"1d3001debd47ea8820d1d89e650ae20489d0bd8822dac5ee2795f16146173003"} Jul 16 00:13:06.632871 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.632829 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-clfwg" podStartSLOduration=3.329440527 podStartE2EDuration="22.632811037s" totalImagesPullingTime="19.30337051s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:06.632404945 +0000 UTC m=+22.700268254" watchObservedRunningTime="2026-07-16 00:13:06.632811037 +0000 UTC m=+22.700674325" Jul 16 00:13:06.648319 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.648260 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7sjtn" podStartSLOduration=3.264736153 podStartE2EDuration="22.648241388s" totalImagesPullingTime="19.383505235s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:06.647377319 +0000 UTC m=+22.715240609" watchObservedRunningTime="2026-07-16 00:13:06.648241388 +0000 UTC m=+22.716104677" Jul 16 00:13:06.661834 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.661780 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-p4s2z" podStartSLOduration=3.2905004350000002 podStartE2EDuration="22.661763562s" totalImagesPullingTime="19.371263127s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:06.661337619 +0000 UTC m=+22.729200907" watchObservedRunningTime="2026-07-16 00:13:06.661763562 +0000 UTC m=+22.729626850" Jul 16 00:13:06.684049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:06.683079 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ln44r" podStartSLOduration=3.383556073 podStartE2EDuration="22.68305045s" totalImagesPullingTime="19.299494377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:06.681006425 +0000 UTC m=+22.748869739" watchObservedRunningTime="2026-07-16 00:13:06.68305045 +0000 UTC m=+22.750913739" Jul 16 00:13:07.314324 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.314296 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:13:07.314948 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.314931 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:13:07.351681 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.351581 2557 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 16 00:13:07.376384 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.376352 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:07.376384 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.376387 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:07.376584 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.376401 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:07.376584 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:07.376499 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:07.376672 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:07.376584 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:07.376672 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:07.376661 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:07.596124 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.596087 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" event={"ID":"38082aa6ed7e2d8aef36fbf429f78a18","Type":"ContainerStarted","Data":"25d3f932a67e18bc62683c6af09d05cc12da46fa18f987cdc9a8c779575eb4cd"} Jul 16 00:13:07.598336 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.598305 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" event={"ID":"7895e090-ae54-4835-a8f8-782ca5c8ff78","Type":"ContainerStarted","Data":"9c04e166c747880c3c6a4ae505222e58bbe3cd3387da0568000b32d60f0015d4"} Jul 16 00:13:07.605561 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.605535 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:13:07.606225 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.606197 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7sjtn" Jul 16 00:13:07.610161 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:07.610115 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-255.ec2.internal" podStartSLOduration=22.610098968 podStartE2EDuration="22.610098968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:07.609710051 +0000 UTC m=+23.677573340" watchObservedRunningTime="2026-07-16 00:13:07.610098968 +0000 UTC m=+23.677962256" Jul 16 00:13:08.346292 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:08.346179 2557 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-16T00:13:07.351600305Z","UUID":"98944c81-7088-4fe8-9afe-1c878fc2f62c","Handler":null,"Name":"","Endpoint":""} Jul 16 00:13:08.347881 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:08.347858 2557 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 16 00:13:08.348007 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:08.347908 2557 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 16 00:13:08.604068 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:08.604043 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:13:08.604520 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:08.604491 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"7107680a077ebaf26d4fd20e859b09ec0013c7568e96bf279dd5b735f4983fae"} Jul 16 00:13:09.377100 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:09.376897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:09.377290 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:09.376897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:09.377290 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:09.377196 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:09.377290 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:09.376897 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:09.377290 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:09.377264 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:09.377442 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:09.377342 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:09.609169 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:09.609127 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" event={"ID":"7895e090-ae54-4835-a8f8-782ca5c8ff78","Type":"ContainerStarted","Data":"dcda7d24063abb45a8297af0269586d98cf2575b88125468af39f7eeacb57b07"} Jul 16 00:13:11.376979 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.376767 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:11.377632 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.376774 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:11.377632 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:11.377068 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:11.377632 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.376823 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:11.377632 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:11.377140 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:11.377632 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:11.377225 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:11.614922 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.614886 2557 generic.go:356] "Generic (PLEG): container finished" podID="8b6df3a6-3d16-4cce-8eec-bec871402de0" containerID="666740c2863db1a935b80e6682c4891d3d1cc694bdb395630f0665ee2fc86376" exitCode=0 Jul 16 00:13:11.615139 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.614987 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerDied","Data":"666740c2863db1a935b80e6682c4891d3d1cc694bdb395630f0665ee2fc86376"} Jul 16 00:13:11.618391 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.618368 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:13:11.618778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.618752 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"0cce393cd894e2f99840b55286e77007f0680c1de3fb93b3e53ebc56c4007a24"} Jul 16 00:13:11.619072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.619055 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:13:11.619162 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.619131 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:13:11.619230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.619217 2557 scope.go:117] "RemoveContainer" containerID="b4a6283916ae729880853d2ac3e656462fb010e88b754c5a9fd51d9d0e869b78" Jul 16 00:13:11.635657 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.635636 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:13:11.642542 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:11.642500 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2jpww" podStartSLOduration=5.898566456 podStartE2EDuration="27.642484274s" totalImagesPullingTime="21.743917818s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:09.625274723 +0000 UTC m=+25.693138034" watchObservedRunningTime="2026-07-16 00:13:11.642484274 +0000 UTC m=+27.710347558" Jul 16 00:13:12.622260 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.622227 2557 generic.go:356] "Generic (PLEG): container finished" podID="8b6df3a6-3d16-4cce-8eec-bec871402de0" containerID="a1dd22b1ad0eb09305205491d5bf5cddf8a224345daf72af4131d9b5bd8191f0" exitCode=0 Jul 16 00:13:12.622717 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.622306 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerDied","Data":"a1dd22b1ad0eb09305205491d5bf5cddf8a224345daf72af4131d9b5bd8191f0"} Jul 16 00:13:12.626151 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.626130 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:13:12.626482 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.626459 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" event={"ID":"d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870","Type":"ContainerStarted","Data":"08993ad202913e23b19a3fddd48dbf95f54946be860535a3a582d122f8d1e6f5"} Jul 16 00:13:12.626735 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.626718 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:13:12.641737 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.641714 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:13:12.665785 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.665732 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" podStartSLOduration=8.907219269 podStartE2EDuration="28.665712179s" totalImagesPullingTime="19.75849291s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:12.665682338 +0000 UTC m=+28.733545627" watchObservedRunningTime="2026-07-16 00:13:12.665712179 +0000 UTC m=+28.733575469" Jul 16 00:13:12.678254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.678223 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-92z4p"] Jul 16 00:13:12.678407 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.678344 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:12.678468 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:12.678429 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:12.678889 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.678868 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lf7sl"] Jul 16 00:13:12.678974 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.678952 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:12.679059 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:12.679043 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:12.680379 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.680360 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6t5jv"] Jul 16 00:13:12.680464 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:12.680429 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:12.680517 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:12.680499 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:14.378230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:14.378199 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:14.378603 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:14.378284 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:14.378603 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:14.378325 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:14.378603 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:14.378315 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:14.378603 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:14.378414 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:14.378603 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:14.378497 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:14.633022 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:14.632930 2557 generic.go:356] "Generic (PLEG): container finished" podID="8b6df3a6-3d16-4cce-8eec-bec871402de0" containerID="dd4342d3e386510c357534c39caea5e3370ebd7ce605e2e9e3806db64ecff871" exitCode=0 Jul 16 00:13:14.633022 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:14.633003 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerDied","Data":"dd4342d3e386510c357534c39caea5e3370ebd7ce605e2e9e3806db64ecff871"} Jul 16 00:13:16.377312 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:16.377059 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:16.377898 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:16.377073 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:16.377898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:16.377408 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6t5jv" podUID="0e11e69e-30aa-431f-8718-a4696c6007cd" Jul 16 00:13:16.377898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:16.377517 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-92z4p" podUID="a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0" Jul 16 00:13:16.377898 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:16.377145 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:16.377898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:16.377615 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:13:17.033402 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:17.033369 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:17.033559 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.033493 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:13:17.033559 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.033550 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:13:49.033534706 +0000 UTC m=+65.101397972 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 16 00:13:17.133971 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:17.133883 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:17.134125 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.134085 2557 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 16 00:13:17.134167 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.134156 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret podName:a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:49.134139662 +0000 UTC m=+65.202002928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret") pod "global-pull-secret-syncer-92z4p" (UID: "a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0") : object "kube-system"/"original-pull-secret" not registered Jul 16 00:13:17.234623 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:17.234580 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:17.234797 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.234737 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 16 00:13:17.234797 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.234755 2557 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 16 00:13:17.234797 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.234764 2557 projected.go:196] Error preparing data for projected volume kube-api-access-qqlnz for pod openshift-network-diagnostics/network-check-target-6t5jv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:13:17.234908 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:17.234818 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz podName:0e11e69e-30aa-431f-8718-a4696c6007cd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:49.234803278 +0000 UTC m=+65.302666548 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qqlnz" (UniqueName: "kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz") pod "network-check-target-6t5jv" (UID: "0e11e69e-30aa-431f-8718-a4696c6007cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 16 00:13:18.262828 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.262796 2557 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-255.ec2.internal" event="NodeReady" Jul 16 00:13:18.263411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.262947 2557 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 16 00:13:18.297530 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.297490 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-59bf9ccdd7-7q8rc"] Jul 16 00:13:18.327268 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.327189 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-gvm7j"] Jul 16 00:13:18.327447 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.327282 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.330300 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.330224 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 16 00:13:18.330493 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.330465 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 16 00:13:18.330651 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.330633 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cws9t\"" Jul 16 00:13:18.330717 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.330663 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 16 00:13:18.338528 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.338504 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 16 00:13:18.343049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.343028 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8c8t6"] Jul 16 00:13:18.343184 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.343167 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:18.346326 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.346305 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 16 00:13:18.346432 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.346308 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2vrt7\"" Jul 16 00:13:18.346432 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.346352 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 16 00:13:18.361161 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.361136 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xl2bf"] Jul 16 00:13:18.361281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.361259 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.364034 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.364015 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djqcn\"" Jul 16 00:13:18.364129 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.364034 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 16 00:13:18.364359 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.364336 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 16 00:13:18.380375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.380347 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-gvm7j"] Jul 16 00:13:18.380516 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.380386 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bf9ccdd7-7q8rc"] Jul 16 00:13:18.380516 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.380406 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8c8t6"] Jul 16 00:13:18.380516 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.380413 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:18.380516 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.380420 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:18.380646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.380517 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:18.381067 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.380793 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.383229 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.383210 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9p7\"" Jul 16 00:13:18.383371 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.383352 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:13:18.383562 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.383543 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 16 00:13:18.383652 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.383545 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:13:18.383710 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.383653 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct92c\"" Jul 16 00:13:18.383813 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.383797 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:13:18.383888 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.383878 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 16 00:13:18.384070 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.384056 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:13:18.384354 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.384336 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 16 00:13:18.384452 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.384414 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kj65f\"" Jul 16 00:13:18.384539 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.384523 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xl2bf"] Jul 16 00:13:18.443206 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-installation-pull-secrets\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.443377 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443222 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-config-volume\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.443377 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443251 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.443377 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443269 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-certificates\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.443377 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443342 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4186df4d-9f2d-47a8-871f-5bbe96398daa-ca-trust-extracted\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.443377 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443359 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-trusted-ca\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.443586 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443381 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:18.443586 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443482 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfj5l\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-kube-api-access-zfj5l\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.443586 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443521 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-tmp-dir\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.443586 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443547 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hhxl\" (UniqueName: \"kubernetes.io/projected/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-kube-api-access-6hhxl\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.443586 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443584 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.443787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443609 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2349fdd8-9fb4-4277-bf29-4119d44e9997-nginx-conf\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:18.443787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443635 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-image-registry-private-configuration\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.443787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.443662 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-bound-sa-token\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.544567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544472 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4186df4d-9f2d-47a8-871f-5bbe96398daa-ca-trust-extracted\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.544567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544522 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-trusted-ca\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.544567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544548 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:18.544769 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:18.544644 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:13:18.544769 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544677 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb9gr\" (UniqueName: \"kubernetes.io/projected/bfc590a9-0257-4e81-8ae1-13d8be2b7098-kube-api-access-hb9gr\") pod \"ingress-canary-xl2bf\" (UID: \"bfc590a9-0257-4e81-8ae1-13d8be2b7098\") " pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.544769 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:18.544705 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:19.04468553 +0000 UTC m=+35.112548819 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:13:18.544769 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544766 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc590a9-0257-4e81-8ae1-13d8be2b7098-cert\") pod \"ingress-canary-xl2bf\" (UID: \"bfc590a9-0257-4e81-8ae1-13d8be2b7098\") " pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.544931 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544816 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfj5l\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-kube-api-access-zfj5l\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.544931 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544856 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-tmp-dir\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.544931 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hhxl\" (UniqueName: \"kubernetes.io/projected/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-kube-api-access-6hhxl\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.544931 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.544931 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544916 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4186df4d-9f2d-47a8-871f-5bbe96398daa-ca-trust-extracted\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.544931 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544924 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2349fdd8-9fb4-4277-bf29-4119d44e9997-nginx-conf\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544944 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-image-registry-private-configuration\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.544994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-bound-sa-token\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:18.545032 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:18.545047 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-installation-pull-secrets\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545076 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-config-volume\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:18.545099 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:13:19.04508299 +0000 UTC m=+35.112946270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545122 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.545252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545147 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-certificates\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.545631 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545255 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-tmp-dir\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.545631 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:18.545362 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:13:18.545631 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:18.545420 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:19.045403955 +0000 UTC m=+35.113267234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:13:18.545631 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545540 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-trusted-ca\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.545631 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545596 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-config-volume\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.545858 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545640 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2349fdd8-9fb4-4277-bf29-4119d44e9997-nginx-conf\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:18.545907 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.545866 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-certificates\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.549702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.549683 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-installation-pull-secrets\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.549702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.549694 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-image-registry-private-configuration\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.555701 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.555667 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfj5l\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-kube-api-access-zfj5l\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.556136 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.556107 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-bound-sa-token\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:18.556249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.556162 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hhxl\" (UniqueName: \"kubernetes.io/projected/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-kube-api-access-6hhxl\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:18.646034 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.646003 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb9gr\" (UniqueName: \"kubernetes.io/projected/bfc590a9-0257-4e81-8ae1-13d8be2b7098-kube-api-access-hb9gr\") pod \"ingress-canary-xl2bf\" (UID: \"bfc590a9-0257-4e81-8ae1-13d8be2b7098\") " pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.646034 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.646035 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc590a9-0257-4e81-8ae1-13d8be2b7098-cert\") pod \"ingress-canary-xl2bf\" (UID: \"bfc590a9-0257-4e81-8ae1-13d8be2b7098\") " pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.648254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.648231 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bfc590a9-0257-4e81-8ae1-13d8be2b7098-cert\") pod \"ingress-canary-xl2bf\" (UID: \"bfc590a9-0257-4e81-8ae1-13d8be2b7098\") " pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.654098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.654078 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb9gr\" (UniqueName: \"kubernetes.io/projected/bfc590a9-0257-4e81-8ae1-13d8be2b7098-kube-api-access-hb9gr\") pod \"ingress-canary-xl2bf\" (UID: \"bfc590a9-0257-4e81-8ae1-13d8be2b7098\") " pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.712610 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.712584 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xl2bf" Jul 16 00:13:18.896434 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:18.896267 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xl2bf"] Jul 16 00:13:18.960313 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:13:18.960276 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc590a9_0257_4e81_8ae1_13d8be2b7098.slice/crio-f17936be36acbb90cb8404ce9a83eb006b681276c1d43254dbd2e3d8e20b47e9 WatchSource:0}: Error finding container f17936be36acbb90cb8404ce9a83eb006b681276c1d43254dbd2e3d8e20b47e9: Status 404 returned error can't find the container with id f17936be36acbb90cb8404ce9a83eb006b681276c1d43254dbd2e3d8e20b47e9 Jul 16 00:13:19.050708 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:19.050675 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:19.050884 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:19.050730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:19.050884 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:19.050767 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:19.050884 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:19.050839 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:13:19.051040 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:19.050884 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:13:19.051040 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:19.050889 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:13:19.051040 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:19.050910 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:13:19.051040 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:19.050925 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:20.050903262 +0000 UTC m=+36.118766550 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:13:19.051040 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:19.050946 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:20.05093617 +0000 UTC m=+36.118799442 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:13:19.051040 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:19.050982 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:13:20.050951703 +0000 UTC m=+36.118814969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:13:19.646175 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:19.646137 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xl2bf" event={"ID":"bfc590a9-0257-4e81-8ae1-13d8be2b7098","Type":"ContainerStarted","Data":"f17936be36acbb90cb8404ce9a83eb006b681276c1d43254dbd2e3d8e20b47e9"} Jul 16 00:13:19.648394 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:19.648371 2557 generic.go:356] "Generic (PLEG): container finished" podID="8b6df3a6-3d16-4cce-8eec-bec871402de0" containerID="18c141c4707d11ce5f44629f4ddb0ee553293025a2580300b3214b3830580625" exitCode=0 Jul 16 00:13:19.648485 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:19.648424 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerDied","Data":"18c141c4707d11ce5f44629f4ddb0ee553293025a2580300b3214b3830580625"} Jul 16 00:13:20.058215 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:20.058173 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:20.058384 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:20.058338 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:13:20.058384 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:20.058357 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:20.058517 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:20.058407 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:22.05838757 +0000 UTC m=+38.126250841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:13:20.058517 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:20.058450 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:20.058517 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:20.058455 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:13:20.058517 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:20.058501 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:13:20.058517 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:20.058514 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:13:20.058741 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:20.058536 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:22.05852409 +0000 UTC m=+38.126387377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:13:20.058741 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:20.058563 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:13:22.058545562 +0000 UTC m=+38.126408834 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:13:20.653885 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:20.653854 2557 generic.go:356] "Generic (PLEG): container finished" podID="8b6df3a6-3d16-4cce-8eec-bec871402de0" containerID="85f46103e3ae7d369c01d78f58c02de6a0218c1a61ac57fae45097d444f64fce" exitCode=0 Jul 16 00:13:20.654280 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:20.653913 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerDied","Data":"85f46103e3ae7d369c01d78f58c02de6a0218c1a61ac57fae45097d444f64fce"} Jul 16 00:13:21.658795 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:21.658557 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xl2bf" event={"ID":"bfc590a9-0257-4e81-8ae1-13d8be2b7098","Type":"ContainerStarted","Data":"bdbd55dc1b88cedafdc2b911c92d3c005a136dd458fda6a4e4a2fa49c97a2fe8"} Jul 16 00:13:21.662280 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:21.662255 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-stns6" event={"ID":"8b6df3a6-3d16-4cce-8eec-bec871402de0","Type":"ContainerStarted","Data":"3fedd18ec0da540c221d36eeb48c378736d92d148c750718653ec0db419a0161"} Jul 16 00:13:21.674354 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:21.674310 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xl2bf" podStartSLOduration=1.101614186 podStartE2EDuration="3.674293477s" totalImagesPullingTime="2.572679291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:21.673253548 +0000 UTC m=+37.741116837" watchObservedRunningTime="2026-07-16 00:13:21.674293477 +0000 UTC m=+37.742156765" Jul 16 00:13:21.696514 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:21.696454 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-stns6" podStartSLOduration=7.953542438 podStartE2EDuration="37.696434772s" totalImagesPullingTime="29.742892334s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:21.695602273 +0000 UTC m=+37.763465582" watchObservedRunningTime="2026-07-16 00:13:21.696434772 +0000 UTC m=+37.764298062" Jul 16 00:13:21.837122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:21.837037 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:21.946125 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:21.946087 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:22.041775 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:22.041742 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:22.075848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:22.075800 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:22.075848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:22.075849 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:22.076080 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:22.075915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:22.076080 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:22.075954 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:13:22.076080 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:22.075992 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:13:22.076080 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:22.076043 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:13:22.076080 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:22.076052 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:13:26.076035145 +0000 UTC m=+42.143898411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:13:22.076248 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:22.076099 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:26.076086796 +0000 UTC m=+42.143950066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:13:22.076248 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:22.076043 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:13:22.076248 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:22.076170 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:26.076156497 +0000 UTC m=+42.144019764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:13:23.218328 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:23.218295 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:26.103498 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:26.103462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:26.103534 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:26.103567 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:26.103638 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:26.103684 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:26.103705 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:34.103688249 +0000 UTC m=+50.171551519 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:26.103649 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:26.103746 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:26.103751 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:34.103736835 +0000 UTC m=+50.171600101 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:13:26.103898 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:26.103782 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:13:34.103769298 +0000 UTC m=+50.171632567 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:13:33.781687 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:33.781655 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:33.833616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:33.833580 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:34.162723 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:34.162628 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:34.162723 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:34.162674 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:34.162740 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:34.162812 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:34.162836 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:34.162849 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:34.162849 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:34.162901 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:13:50.16288188 +0000 UTC m=+66.230745162 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:34.162923 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:13:50.162912367 +0000 UTC m=+66.230775634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:13:34.162955 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:34.162939 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:13:50.162929903 +0000 UTC m=+66.230793175 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:13:34.726817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:34.726781 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:34.827359 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:34.827326 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:37.350926 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:37.350886 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:37.403202 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:37.403173 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:38.357907 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:38.357872 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:38.457834 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:38.457800 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:40.126353 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:40.126258 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:40.309389 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:40.309329 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:44.644180 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:44.644097 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wvknh" Jul 16 00:13:44.791075 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:44.791042 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:44.841113 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:44.841078 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:49.071852 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.071808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:13:49.074504 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.074487 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 16 00:13:49.082499 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:49.082478 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:13:49.082564 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:49.082535 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:14:53.082518958 +0000 UTC m=+129.150382225 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : secret "metrics-daemon-secret" not found Jul 16 00:13:49.172537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.172499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:49.175080 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.175063 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 16 00:13:49.186702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.186680 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0-original-pull-secret\") pod \"global-pull-secret-syncer-92z4p\" (UID: \"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0\") " pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:49.273168 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.273137 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:49.275996 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.275977 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 16 00:13:49.286030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.286012 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 16 00:13:49.296264 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.296238 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqlnz\" (UniqueName: \"kubernetes.io/projected/0e11e69e-30aa-431f-8718-a4696c6007cd-kube-api-access-qqlnz\") pod \"network-check-target-6t5jv\" (UID: \"0e11e69e-30aa-431f-8718-a4696c6007cd\") " pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:49.301412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.301396 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sl9p7\"" Jul 16 00:13:49.306488 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.306472 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-92z4p" Jul 16 00:13:49.309600 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.309585 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:49.477355 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.477326 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-92z4p"] Jul 16 00:13:49.480398 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:13:49.480372 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda89f1a0c_990c_4c98_bf3f_67ddc8b2d0d0.slice/crio-53dd7b2c0eab40016a4df745999b1768996c7bd7eccb53682390c4796a3438d4 WatchSource:0}: Error finding container 53dd7b2c0eab40016a4df745999b1768996c7bd7eccb53682390c4796a3438d4: Status 404 returned error can't find the container with id 53dd7b2c0eab40016a4df745999b1768996c7bd7eccb53682390c4796a3438d4 Jul 16 00:13:49.500060 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.500037 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6t5jv"] Jul 16 00:13:49.502531 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:13:49.502512 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e11e69e_30aa_431f_8718_a4696c6007cd.slice/crio-a4df94c2a49a32706471f47f610746b118f0d7ad8d36c56ef7e45a5d55e3524c WatchSource:0}: Error finding container a4df94c2a49a32706471f47f610746b118f0d7ad8d36c56ef7e45a5d55e3524c: Status 404 returned error can't find the container with id a4df94c2a49a32706471f47f610746b118f0d7ad8d36c56ef7e45a5d55e3524c Jul 16 00:13:49.725263 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.725179 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-92z4p" event={"ID":"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0","Type":"ContainerStarted","Data":"53dd7b2c0eab40016a4df745999b1768996c7bd7eccb53682390c4796a3438d4"} Jul 16 00:13:49.726215 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.726192 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6t5jv" event={"ID":"0e11e69e-30aa-431f-8718-a4696c6007cd","Type":"ContainerStarted","Data":"a4df94c2a49a32706471f47f610746b118f0d7ad8d36c56ef7e45a5d55e3524c"} Jul 16 00:13:49.818157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.818128 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:49.913100 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:49.913066 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:50.014805 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:50.014750 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:50.179783 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:50.179749 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:50.179791 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:50.179830 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:50.179901 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:50.179940 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:50.179984 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:14:22.179950416 +0000 UTC m=+98.247813703 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:50.180004 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:14:22.17999429 +0000 UTC m=+98.247857559 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:50.180083 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:50.180102 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:13:50.180243 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:13:50.180161 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:14:22.180143846 +0000 UTC m=+98.248007112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:13:50.312190 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:50.312095 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:52.736877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:52.736848 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6t5jv" event={"ID":"0e11e69e-30aa-431f-8718-a4696c6007cd","Type":"ContainerStarted","Data":"d215d1090d9e927a64ea78d74a31dac7ec97bbfc43631474d9b136232ac57633"} Jul 16 00:13:52.737350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:52.736992 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:13:52.752050 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:52.751988 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6t5jv" podStartSLOduration=65.888416652 podStartE2EDuration="1m8.751951403s" totalImagesPullingTime="2.863534751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:52.751490311 +0000 UTC m=+68.819353599" watchObservedRunningTime="2026-07-16 00:13:52.751951403 +0000 UTC m=+68.819814691" Jul 16 00:13:54.474844 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:54.474747 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:54.574741 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:54.574703 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:54.674618 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:54.674589 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:13:54.743024 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:54.742992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-92z4p" event={"ID":"a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0","Type":"ContainerStarted","Data":"768ef3b7af7a587a468b32a956c6ba6e023ec44a8cac17bcfeba3b71c00608cf"} Jul 16 00:13:54.758732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:13:54.758689 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-92z4p" podStartSLOduration=66.207803207 podStartE2EDuration="1m10.758675618s" totalImagesPullingTime="4.550872411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:13:54.75816309 +0000 UTC m=+70.826026399" watchObservedRunningTime="2026-07-16 00:13:54.758675618 +0000 UTC m=+70.826538906" Jul 16 00:14:11.797623 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:11.797502 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:14:11.848180 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:11.848142 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:14:15.399764 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:15.399725 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:14:15.495941 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:15.495906 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:14:15.545281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:15.545245 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:14:22.211792 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:22.211738 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:14:22.211792 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:22.211798 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:22.211835 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:22.211894 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:22.211931 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:22.211979 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:22.212001 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:22.212011 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:15:26.211992051 +0000 UTC m=+162.279855318 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:22.212026 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:15:26.212019797 +0000 UTC m=+162.279883063 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:14:22.212395 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:22.212098 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:15:26.212077815 +0000 UTC m=+162.279941089 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:14:23.742607 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:23.742576 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6t5jv" Jul 16 00:14:53.124536 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:14:53.124499 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:14:53.124990 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:53.124664 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:14:53.124990 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:14:53.124744 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:16:55.124724874 +0000 UTC m=+251.192588141 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : secret "metrics-daemon-secret" not found Jul 16 00:15:09.495141 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:09.495101 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:15:21.340104 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:21.340049 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" Jul 16 00:15:21.353221 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:21.353190 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" podUID="2349fdd8-9fb4-4277-bf29-4119d44e9997" Jul 16 00:15:21.371383 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:21.371352 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8c8t6" podUID="5731da3f-fd39-4944-a7b0-ecc6b88bbccd" Jul 16 00:15:21.391910 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:21.391884 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:15:21.947473 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:21.947444 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8c8t6" Jul 16 00:15:21.947672 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:21.947446 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:15:21.947672 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:21.947444 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:15:26.265404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:26.265354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:15:26.265404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:26.265405 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:26.265430 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:26.265509 2557 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:26.265511 2557 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:26.265553 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls podName:5731da3f-fd39-4944-a7b0-ecc6b88bbccd nodeName:}" failed. No retries permitted until 2026-07-16 00:17:28.265539847 +0000 UTC m=+284.333403114 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls") pod "dns-default-8c8t6" (UID: "5731da3f-fd39-4944-a7b0-ecc6b88bbccd") : secret "dns-default-metrics-tls" not found Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:26.265580 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert podName:2349fdd8-9fb4-4277-bf29-4119d44e9997 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:28.265566132 +0000 UTC m=+284.333429399 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-gvm7j" (UID: "2349fdd8-9fb4-4277-bf29-4119d44e9997") : secret "networking-console-plugin-cert" not found Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:26.265517 2557 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:26.265596 2557 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-59bf9ccdd7-7q8rc: secret "image-registry-tls" not found Jul 16 00:15:26.265849 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:15:26.265620 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls podName:4186df4d-9f2d-47a8-871f-5bbe96398daa nodeName:}" failed. No retries permitted until 2026-07-16 00:17:28.265613333 +0000 UTC m=+284.333476599 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls") pod "image-registry-59bf9ccdd7-7q8rc" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa") : secret "image-registry-tls" not found Jul 16 00:15:36.376856 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:15:36.376765 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:16:55.194282 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:16:55.194241 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:16:55.194758 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:16:55.194387 2557 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 16 00:16:55.194758 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:16:55.194464 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs podName:60590034-ae94-403d-8bcd-0092f90dbbfe nodeName:}" failed. No retries permitted until 2026-07-16 00:18:57.194448292 +0000 UTC m=+373.262311559 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs") pod "network-metrics-daemon-lf7sl" (UID: "60590034-ae94-403d-8bcd-0092f90dbbfe") : secret "metrics-daemon-secret" not found Jul 16 00:16:56.015956 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:16:56.015921 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:00.135410 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.135378 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns"] Jul 16 00:17:00.138236 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.138216 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.138810 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.138783 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2"] Jul 16 00:17:00.141871 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.141584 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 16 00:17:00.142009 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.141976 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 16 00:17:00.142356 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.142332 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 16 00:17:00.144094 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.144071 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-76dbt\"" Jul 16 00:17:00.144244 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.144225 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 16 00:17:00.144630 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.144611 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-774b4878-z7tnc"] Jul 16 00:17:00.144747 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.144730 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" Jul 16 00:17:00.147602 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.147219 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-wfgpj"] Jul 16 00:17:00.147602 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.147272 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-l7p6f\"" Jul 16 00:17:00.147602 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.147423 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 16 00:17:00.147811 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.147736 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.147811 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.147807 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:17:00.150226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.150207 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.150599 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.150273 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 16 00:17:00.150689 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.150629 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 16 00:17:00.150689 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.150661 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 16 00:17:00.150799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.150787 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-nr7hb\"" Jul 16 00:17:00.151171 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.151155 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 16 00:17:00.151397 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.151377 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 16 00:17:00.151497 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.151399 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 16 00:17:00.151690 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.151673 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns"] Jul 16 00:17:00.152379 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.152361 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2"] Jul 16 00:17:00.155859 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.155833 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 16 00:17:00.156063 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.156044 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 16 00:17:00.156180 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.155912 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 16 00:17:00.156180 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.155870 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 16 00:17:00.157817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.157797 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-mqgjw\"" Jul 16 00:17:00.158663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.158644 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-wfgpj"] Jul 16 00:17:00.162983 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.162952 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 16 00:17:00.164559 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.164535 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-774b4878-z7tnc"] Jul 16 00:17:00.227237 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227208 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.227392 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227290 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bftj\" (UniqueName: \"kubernetes.io/projected/05919e70-19c6-4b38-aa0d-b031cb6ca19e-kube-api-access-9bftj\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.227392 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227321 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbt84\" (UniqueName: \"kubernetes.io/projected/d947280c-42ee-4fea-a2a9-bec881864104-kube-api-access-sbt84\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.227392 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227342 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05919e70-19c6-4b38-aa0d-b031cb6ca19e-tmp\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.227392 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227365 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-default-certificate\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.227560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227438 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05919e70-19c6-4b38-aa0d-b031cb6ca19e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.227560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227467 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05919e70-19c6-4b38-aa0d-b031cb6ca19e-serving-cert\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.227560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227532 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27r76\" (UniqueName: \"kubernetes.io/projected/f06db588-0616-4879-966d-9abe1add02e6-kube-api-access-27r76\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.227698 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227557 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05919e70-19c6-4b38-aa0d-b031cb6ca19e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.227698 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227604 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d947280c-42ee-4fea-a2a9-bec881864104-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.227698 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227681 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.227810 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227713 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05919e70-19c6-4b38-aa0d-b031cb6ca19e-snapshots\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.227810 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-stats-auth\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.227877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.227877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227843 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gknbh\" (UniqueName: \"kubernetes.io/projected/884752ee-822d-4936-8c43-54cbe3ec56d7-kube-api-access-gknbh\") pod \"volume-data-source-validator-78495597f6-k84z2\" (UID: \"884752ee-822d-4936-8c43-54cbe3ec56d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" Jul 16 00:17:00.227941 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.227926 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb"] Jul 16 00:17:00.230877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.230858 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" Jul 16 00:17:00.231201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.231176 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn"] Jul 16 00:17:00.233253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.233235 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-rdlgm\"" Jul 16 00:17:00.233700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.233681 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.236547 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.236523 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 16 00:17:00.236729 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.236702 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:17:00.236799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.236752 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 16 00:17:00.236998 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.236822 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xkz94\"" Jul 16 00:17:00.237594 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.237560 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 16 00:17:00.256313 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.256291 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn"] Jul 16 00:17:00.257013 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.256997 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb"] Jul 16 00:17:00.328787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.328752 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05919e70-19c6-4b38-aa0d-b031cb6ca19e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.328787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.328790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13762bc-4e13-4922-afe2-968150abdcc5-config\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.329072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.328814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqskr\" (UniqueName: \"kubernetes.io/projected/8fe51b3d-33f8-453d-8e90-a31aa6e14aaf-kube-api-access-sqskr\") pod \"network-check-source-869dcfcdcd-r5wqb\" (UID: \"8fe51b3d-33f8-453d-8e90-a31aa6e14aaf\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" Jul 16 00:17:00.329072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.328897 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13762bc-4e13-4922-afe2-968150abdcc5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.329072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.328945 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d947280c-42ee-4fea-a2a9-bec881864104-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.329072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329000 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.329072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329021 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05919e70-19c6-4b38-aa0d-b031cb6ca19e-snapshots\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.329072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-stats-auth\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.329072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329105 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gknbh\" (UniqueName: \"kubernetes.io/projected/884752ee-822d-4936-8c43-54cbe3ec56d7-kube-api-access-gknbh\") pod \"volume-data-source-validator-78495597f6-k84z2\" (UID: \"884752ee-822d-4936-8c43-54cbe3ec56d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.329149 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:00.829128749 +0000 UTC m=+256.896992041 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : configmap references non-existent config key: service-ca.crt Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bftj\" (UniqueName: \"kubernetes.io/projected/05919e70-19c6-4b38-aa0d-b031cb6ca19e-kube-api-access-9bftj\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.329202 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329217 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbt84\" (UniqueName: \"kubernetes.io/projected/d947280c-42ee-4fea-a2a9-bec881864104-kube-api-access-sbt84\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329237 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05919e70-19c6-4b38-aa0d-b031cb6ca19e-tmp\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.329262 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls podName:d947280c-42ee-4fea-a2a9-bec881864104 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:00.829245772 +0000 UTC m=+256.897109039 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hprns" (UID: "d947280c-42ee-4fea-a2a9-bec881864104") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329287 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9gv4\" (UniqueName: \"kubernetes.io/projected/d13762bc-4e13-4922-afe2-968150abdcc5-kube-api-access-d9gv4\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329322 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-default-certificate\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05919e70-19c6-4b38-aa0d-b031cb6ca19e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329390 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05919e70-19c6-4b38-aa0d-b031cb6ca19e-serving-cert\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.329442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329391 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05919e70-19c6-4b38-aa0d-b031cb6ca19e-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.330079 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27r76\" (UniqueName: \"kubernetes.io/projected/f06db588-0616-4879-966d-9abe1add02e6-kube-api-access-27r76\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.330079 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.329464 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 00:17:00.330079 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.329524 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:00.829509439 +0000 UTC m=+256.897372706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : secret "router-metrics-certs-default" not found Jul 16 00:17:00.330079 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329659 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/05919e70-19c6-4b38-aa0d-b031cb6ca19e-snapshots\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.330079 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329777 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d947280c-42ee-4fea-a2a9-bec881864104-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.330079 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.329819 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/05919e70-19c6-4b38-aa0d-b031cb6ca19e-tmp\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.331139 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.331116 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05919e70-19c6-4b38-aa0d-b031cb6ca19e-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.331658 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.331636 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-stats-auth\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.331946 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.331924 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/05919e70-19c6-4b38-aa0d-b031cb6ca19e-serving-cert\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.332006 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.331951 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-default-certificate\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.337514 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.337490 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gknbh\" (UniqueName: \"kubernetes.io/projected/884752ee-822d-4936-8c43-54cbe3ec56d7-kube-api-access-gknbh\") pod \"volume-data-source-validator-78495597f6-k84z2\" (UID: \"884752ee-822d-4936-8c43-54cbe3ec56d7\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" Jul 16 00:17:00.339283 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.339259 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbt84\" (UniqueName: \"kubernetes.io/projected/d947280c-42ee-4fea-a2a9-bec881864104-kube-api-access-sbt84\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.339420 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.339404 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bftj\" (UniqueName: \"kubernetes.io/projected/05919e70-19c6-4b38-aa0d-b031cb6ca19e-kube-api-access-9bftj\") pod \"insights-operator-68d9dd94cf-wfgpj\" (UID: \"05919e70-19c6-4b38-aa0d-b031cb6ca19e\") " pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.340077 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.340059 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27r76\" (UniqueName: \"kubernetes.io/projected/f06db588-0616-4879-966d-9abe1add02e6-kube-api-access-27r76\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.399289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.399226 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:00.429801 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.429770 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9gv4\" (UniqueName: \"kubernetes.io/projected/d13762bc-4e13-4922-afe2-968150abdcc5-kube-api-access-d9gv4\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.429918 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.429838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13762bc-4e13-4922-afe2-968150abdcc5-config\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.429918 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.429863 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqskr\" (UniqueName: \"kubernetes.io/projected/8fe51b3d-33f8-453d-8e90-a31aa6e14aaf-kube-api-access-sqskr\") pod \"network-check-source-869dcfcdcd-r5wqb\" (UID: \"8fe51b3d-33f8-453d-8e90-a31aa6e14aaf\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" Jul 16 00:17:00.429918 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.429885 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13762bc-4e13-4922-afe2-968150abdcc5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.430500 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.430474 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d13762bc-4e13-4922-afe2-968150abdcc5-config\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.432038 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.432012 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d13762bc-4e13-4922-afe2-968150abdcc5-serving-cert\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.437731 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.437711 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9gv4\" (UniqueName: \"kubernetes.io/projected/d13762bc-4e13-4922-afe2-968150abdcc5-kube-api-access-d9gv4\") pod \"service-ca-operator-7695fc6c8c-sgxdn\" (UID: \"d13762bc-4e13-4922-afe2-968150abdcc5\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.437948 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.437931 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqskr\" (UniqueName: \"kubernetes.io/projected/8fe51b3d-33f8-453d-8e90-a31aa6e14aaf-kube-api-access-sqskr\") pod \"network-check-source-869dcfcdcd-r5wqb\" (UID: \"8fe51b3d-33f8-453d-8e90-a31aa6e14aaf\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" Jul 16 00:17:00.459881 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.459854 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" Jul 16 00:17:00.472010 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.471992 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" Jul 16 00:17:00.499801 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.499765 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:00.540330 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.540276 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" Jul 16 00:17:00.544626 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.544406 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" Jul 16 00:17:00.593640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.593602 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2"] Jul 16 00:17:00.595705 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:00.595638 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884752ee_822d_4936_8c43_54cbe3ec56d7.slice/crio-1686a474e73881c8ed75f9d1c782ca46c2e92e33de517bc6114615a3678db9a1 WatchSource:0}: Error finding container 1686a474e73881c8ed75f9d1c782ca46c2e92e33de517bc6114615a3678db9a1: Status 404 returned error can't find the container with id 1686a474e73881c8ed75f9d1c782ca46c2e92e33de517bc6114615a3678db9a1 Jul 16 00:17:00.618158 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.618088 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-wfgpj"] Jul 16 00:17:00.623310 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:00.623280 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05919e70_19c6_4b38_aa0d_b031cb6ca19e.slice/crio-bbb9b32d7d54945e4dce2d984b387f192e537af9775f2978efeeecee8dc365e8 WatchSource:0}: Error finding container bbb9b32d7d54945e4dce2d984b387f192e537af9775f2978efeeecee8dc365e8: Status 404 returned error can't find the container with id bbb9b32d7d54945e4dce2d984b387f192e537af9775f2978efeeecee8dc365e8 Jul 16 00:17:00.678167 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.678086 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb"] Jul 16 00:17:00.680565 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:00.680541 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe51b3d_33f8_453d_8e90_a31aa6e14aaf.slice/crio-fd25eca4ac5f38db2e2b91c45d214193b17eb8bd0746f8b0a3d15cebc2eedd16 WatchSource:0}: Error finding container fd25eca4ac5f38db2e2b91c45d214193b17eb8bd0746f8b0a3d15cebc2eedd16: Status 404 returned error can't find the container with id fd25eca4ac5f38db2e2b91c45d214193b17eb8bd0746f8b0a3d15cebc2eedd16 Jul 16 00:17:00.689485 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.689461 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn"] Jul 16 00:17:00.692194 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:00.692176 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd13762bc_4e13_4922_afe2_968150abdcc5.slice/crio-dc5cec481cf374db4a7f9b7c7cc5d7c5a66005ffbf4eee0167116aca9a477417 WatchSource:0}: Error finding container dc5cec481cf374db4a7f9b7c7cc5d7c5a66005ffbf4eee0167116aca9a477417: Status 404 returned error can't find the container with id dc5cec481cf374db4a7f9b7c7cc5d7c5a66005ffbf4eee0167116aca9a477417 Jul 16 00:17:00.833113 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.833070 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.833309 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.833123 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:00.833309 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.833211 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:00.833309 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.833242 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:01.833220112 +0000 UTC m=+257.901083379 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : configmap references non-existent config key: service-ca.crt Jul 16 00:17:00.833309 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:00.833294 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:00.833523 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.833329 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls podName:d947280c-42ee-4fea-a2a9-bec881864104 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:01.833304174 +0000 UTC m=+257.901167444 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hprns" (UID: "d947280c-42ee-4fea-a2a9-bec881864104") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:00.833523 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.833366 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 00:17:00.833523 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:00.833410 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:01.833396884 +0000 UTC m=+257.901260153 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : secret "router-metrics-certs-default" not found Jul 16 00:17:01.170468 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.170430 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" event={"ID":"05919e70-19c6-4b38-aa0d-b031cb6ca19e","Type":"ContainerStarted","Data":"bbb9b32d7d54945e4dce2d984b387f192e537af9775f2978efeeecee8dc365e8"} Jul 16 00:17:01.171541 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.171514 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" event={"ID":"884752ee-822d-4936-8c43-54cbe3ec56d7","Type":"ContainerStarted","Data":"1686a474e73881c8ed75f9d1c782ca46c2e92e33de517bc6114615a3678db9a1"} Jul 16 00:17:01.172565 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.172527 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" event={"ID":"d13762bc-4e13-4922-afe2-968150abdcc5","Type":"ContainerStarted","Data":"dc5cec481cf374db4a7f9b7c7cc5d7c5a66005ffbf4eee0167116aca9a477417"} Jul 16 00:17:01.173851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.173829 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" event={"ID":"8fe51b3d-33f8-453d-8e90-a31aa6e14aaf","Type":"ContainerStarted","Data":"b69b560a553aabaaf12292c832ec472df87e50d25486dba3919a804cf25becd5"} Jul 16 00:17:01.173921 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.173860 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" event={"ID":"8fe51b3d-33f8-453d-8e90-a31aa6e14aaf","Type":"ContainerStarted","Data":"fd25eca4ac5f38db2e2b91c45d214193b17eb8bd0746f8b0a3d15cebc2eedd16"} Jul 16 00:17:01.190028 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.189942 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-r5wqb" podStartSLOduration=1.1899209609999999 podStartE2EDuration="1.189920961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:01.188980586 +0000 UTC m=+257.256843868" watchObservedRunningTime="2026-07-16 00:17:01.189920961 +0000 UTC m=+257.257784249" Jul 16 00:17:01.844004 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.843896 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:01.844004 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.843974 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:01.844263 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:01.844019 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:01.844263 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:01.844099 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:03.84407631 +0000 UTC m=+259.911939590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : configmap references non-existent config key: service-ca.crt Jul 16 00:17:01.844263 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:01.844180 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 00:17:01.844263 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:01.844231 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:03.844216066 +0000 UTC m=+259.912079335 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : secret "router-metrics-certs-default" not found Jul 16 00:17:01.844475 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:01.844284 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:01.844475 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:01.844325 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls podName:d947280c-42ee-4fea-a2a9-bec881864104 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:03.844313752 +0000 UTC m=+259.912177018 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hprns" (UID: "d947280c-42ee-4fea-a2a9-bec881864104") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:02.180103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:02.180060 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" event={"ID":"884752ee-822d-4936-8c43-54cbe3ec56d7","Type":"ContainerStarted","Data":"391f94293ac26079d7a2303aa67c0060cf69f215878735769202566b2faa2cc8"} Jul 16 00:17:02.195537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:02.195476 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-k84z2" podStartSLOduration=0.729034868 podStartE2EDuration="2.195453794s" totalImagesPullingTime="1.466418926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:02.193783203 +0000 UTC m=+258.261646517" watchObservedRunningTime="2026-07-16 00:17:02.195453794 +0000 UTC m=+258.263317083" Jul 16 00:17:02.270256 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:02.270220 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:02.322793 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:02.322755 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:03.861615 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:03.861577 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:03.862098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:03.861636 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:03.862098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:03.861734 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:03.862098 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:03.861769 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:03.862098 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:03.861819 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 00:17:03.862098 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:03.861852 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls podName:d947280c-42ee-4fea-a2a9-bec881864104 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:07.861828644 +0000 UTC m=+263.929691933 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hprns" (UID: "d947280c-42ee-4fea-a2a9-bec881864104") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:03.862098 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:03.861873 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:07.86186286 +0000 UTC m=+263.929726127 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : configmap references non-existent config key: service-ca.crt Jul 16 00:17:03.862098 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:03.861890 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:07.861880823 +0000 UTC m=+263.929744090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : secret "router-metrics-certs-default" not found Jul 16 00:17:04.194866 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.194773 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" event={"ID":"d13762bc-4e13-4922-afe2-968150abdcc5","Type":"ContainerStarted","Data":"5209dc3d0a5daf55c58f10487cff8b180c284569e0560907d203a8ff10133e55"} Jul 16 00:17:04.196202 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.196180 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" event={"ID":"05919e70-19c6-4b38-aa0d-b031cb6ca19e","Type":"ContainerStarted","Data":"813e1c54daf40c4cfe4ec22fb7a61971f41a7006b769b735caf167a5860bd7ec"} Jul 16 00:17:04.211594 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.211550 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" podStartSLOduration=1.1376513990000001 podStartE2EDuration="4.211534095s" totalImagesPullingTime="3.073882696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:04.211498688 +0000 UTC m=+260.279361975" watchObservedRunningTime="2026-07-16 00:17:04.211534095 +0000 UTC m=+260.279397384" Jul 16 00:17:04.229835 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.229780 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" podStartSLOduration=1.085937794 podStartE2EDuration="4.229761098s" totalImagesPullingTime="3.143823304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:04.229215571 +0000 UTC m=+260.297078860" watchObservedRunningTime="2026-07-16 00:17:04.229761098 +0000 UTC m=+260.297624387" Jul 16 00:17:04.425548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.425514 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq"] Jul 16 00:17:04.426090 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.426057 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:04.429009 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.428993 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" Jul 16 00:17:04.431365 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.431346 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 16 00:17:04.431450 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.431349 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 16 00:17:04.431450 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.431357 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-84p75\"" Jul 16 00:17:04.439621 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.439599 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq"] Jul 16 00:17:04.467414 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.467356 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l7v8j\" (UniqueName: \"kubernetes.io/projected/e509055a-d4bf-430e-97b9-d7e2b2833829-kube-api-access-l7v8j\") pod \"migrator-7f59b54f6c-4xrmq\" (UID: \"e509055a-d4bf-430e-97b9-d7e2b2833829\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" Jul 16 00:17:04.492065 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.491980 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:04.568500 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.568463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l7v8j\" (UniqueName: \"kubernetes.io/projected/e509055a-d4bf-430e-97b9-d7e2b2833829-kube-api-access-l7v8j\") pod \"migrator-7f59b54f6c-4xrmq\" (UID: \"e509055a-d4bf-430e-97b9-d7e2b2833829\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" Jul 16 00:17:04.575664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.575636 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l7v8j\" (UniqueName: \"kubernetes.io/projected/e509055a-d4bf-430e-97b9-d7e2b2833829-kube-api-access-l7v8j\") pod \"migrator-7f59b54f6c-4xrmq\" (UID: \"e509055a-d4bf-430e-97b9-d7e2b2833829\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" Jul 16 00:17:04.674115 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.674085 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:04.726408 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.726308 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:04.739197 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.739173 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" Jul 16 00:17:04.867729 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.867700 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq"] Jul 16 00:17:04.870270 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:04.870243 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode509055a_d4bf_430e_97b9_d7e2b2833829.slice/crio-51eda6f231896275ab195a344a0249829991aa44b9e36389f18df80a652737f4 WatchSource:0}: Error finding container 51eda6f231896275ab195a344a0249829991aa44b9e36389f18df80a652737f4: Status 404 returned error can't find the container with id 51eda6f231896275ab195a344a0249829991aa44b9e36389f18df80a652737f4 Jul 16 00:17:04.903724 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.903691 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:04.977423 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:04.977333 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:05.200127 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.200086 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" event={"ID":"e509055a-d4bf-430e-97b9-d7e2b2833829","Type":"ContainerStarted","Data":"51eda6f231896275ab195a344a0249829991aa44b9e36389f18df80a652737f4"} Jul 16 00:17:05.415617 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.415579 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:05.418845 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.418820 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lqlwt"] Jul 16 00:17:05.421752 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.421732 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.425545 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.425517 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 16 00:17:05.425670 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.425645 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 16 00:17:05.425737 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.425682 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hdqj5\"" Jul 16 00:17:05.434605 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.434583 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lqlwt"] Jul 16 00:17:05.476581 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.476546 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32f297a0-6414-4518-b18e-908d867d4926-crio-socket\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.476581 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.476583 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.476747 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.476665 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32f297a0-6414-4518-b18e-908d867d4926-data-volume\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.476747 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.476725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.476828 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.476748 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fml6c\" (UniqueName: \"kubernetes.io/projected/32f297a0-6414-4518-b18e-908d867d4926-kube-api-access-fml6c\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.480652 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.480623 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:05.577829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.577793 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.577829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.577828 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fml6c\" (UniqueName: \"kubernetes.io/projected/32f297a0-6414-4518-b18e-908d867d4926-kube-api-access-fml6c\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.578060 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.577879 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32f297a0-6414-4518-b18e-908d867d4926-crio-socket\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.578060 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:05.577912 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:17:05.578060 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.577935 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/32f297a0-6414-4518-b18e-908d867d4926-crio-socket\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.578060 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.577983 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.578060 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:05.578000 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:06.077959501 +0000 UTC m=+262.145822767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : configmap "kube-rbac-proxy" not found Jul 16 00:17:05.578060 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:05.578050 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:17:05.578258 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.578078 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32f297a0-6414-4518-b18e-908d867d4926-data-volume\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.578258 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:05.578085 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:06.078074377 +0000 UTC m=+262.145937644 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : secret "insights-runtime-extractor-tls" not found Jul 16 00:17:05.578348 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.578325 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/32f297a0-6414-4518-b18e-908d867d4926-data-volume\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:05.586300 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:05.586280 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fml6c\" (UniqueName: \"kubernetes.io/projected/32f297a0-6414-4518-b18e-908d867d4926-kube-api-access-fml6c\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:06.083862 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.083767 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:06.084262 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.083869 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:06.084262 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:06.083952 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:17:06.084262 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:06.084005 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:17:06.084262 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:06.084054 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:07.084032638 +0000 UTC m=+263.151895918 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : secret "insights-runtime-extractor-tls" not found Jul 16 00:17:06.084262 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:06.084092 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:07.084071087 +0000 UTC m=+263.151934357 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : configmap "kube-rbac-proxy" not found Jul 16 00:17:06.980620 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.980586 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-2mbts"] Jul 16 00:17:06.983592 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.983576 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:06.986525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.986507 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 16 00:17:06.988022 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.988002 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-2d8b8\"" Jul 16 00:17:06.988022 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.988002 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 16 00:17:06.988185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.988082 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 16 00:17:06.988185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.988151 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 16 00:17:06.991017 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:06.990998 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-2mbts"] Jul 16 00:17:07.022004 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.021974 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:07.083735 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.083712 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:07.091765 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.091745 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.091773 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-signing-key\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.091810 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-signing-cabundle\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.091846 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdkrd\" (UniqueName: \"kubernetes.io/projected/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-kube-api-access-xdkrd\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.091885 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.091912 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.091941 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:09.091926934 +0000 UTC m=+265.159790200 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : secret "insights-runtime-extractor-tls" not found Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.091979 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:17:07.092099 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.092017 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:09.092007352 +0000 UTC m=+265.159870620 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : configmap "kube-rbac-proxy" not found Jul 16 00:17:07.192998 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.192948 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-signing-key\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.193188 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.193013 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-signing-cabundle\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.193188 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.193037 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdkrd\" (UniqueName: \"kubernetes.io/projected/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-kube-api-access-xdkrd\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.193731 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.193711 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-signing-cabundle\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.195292 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.195269 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-signing-key\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.201082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.201062 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdkrd\" (UniqueName: \"kubernetes.io/projected/aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc-kube-api-access-xdkrd\") pod \"service-ca-79f68b9f4f-2mbts\" (UID: \"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc\") " pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.208876 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.208853 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" event={"ID":"e509055a-d4bf-430e-97b9-d7e2b2833829","Type":"ContainerStarted","Data":"9bf27817f2448f10f59f05055f1db4681440fe974913fd92cee18cacceb5b31d"} Jul 16 00:17:07.208992 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.208903 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" event={"ID":"e509055a-d4bf-430e-97b9-d7e2b2833829","Type":"ContainerStarted","Data":"5afc53ad475dbba9f9586f2fd610bfebea03e442d20493a644050a054a3989b3"} Jul 16 00:17:07.224750 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.224703 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-4xrmq" podStartSLOduration=1.66290445 podStartE2EDuration="3.224687135s" totalImagesPullingTime="1.561782685s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:07.223042022 +0000 UTC m=+263.290905310" watchObservedRunningTime="2026-07-16 00:17:07.224687135 +0000 UTC m=+263.292550421" Jul 16 00:17:07.292297 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.292219 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" Jul 16 00:17:07.312380 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.312347 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:07.379658 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.379624 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:07.412813 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.412780 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-79f68b9f4f-2mbts"] Jul 16 00:17:07.416230 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:07.416204 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa70c0e_3e53_4bf9_8f6c_f44bf8f275dc.slice/crio-7501b52ca6b107b3ec24cccdc952c975c0d589ecfcdb3d7f60936fc4883769a6 WatchSource:0}: Error finding container 7501b52ca6b107b3ec24cccdc952c975c0d589ecfcdb3d7f60936fc4883769a6: Status 404 returned error can't find the container with id 7501b52ca6b107b3ec24cccdc952c975c0d589ecfcdb3d7f60936fc4883769a6 Jul 16 00:17:07.900023 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.899991 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:07.900220 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.900043 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:07.900220 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.900073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:07.900220 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.900161 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:15.900142162 +0000 UTC m=+271.968005432 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : configmap references non-existent config key: service-ca.crt Jul 16 00:17:07.900220 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.900210 2557 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 16 00:17:07.900383 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.900222 2557 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:07.900383 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.900258 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs podName:f06db588-0616-4879-966d-9abe1add02e6 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:15.900245468 +0000 UTC m=+271.968108734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs") pod "router-default-774b4878-z7tnc" (UID: "f06db588-0616-4879-966d-9abe1add02e6") : secret "router-metrics-certs-default" not found Jul 16 00:17:07.900383 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:07.900271 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls podName:d947280c-42ee-4fea-a2a9-bec881864104 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:15.900264553 +0000 UTC m=+271.968127819 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-hprns" (UID: "d947280c-42ee-4fea-a2a9-bec881864104") : secret "cluster-monitoring-operator-tls" not found Jul 16 00:17:07.966616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:07.966586 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:08.122772 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.122731 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:08.213018 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.212924 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4s2z_d617bf3a-d495-485e-911d-8d2d7fb978d1/dns-node-resolver/0.log" Jul 16 00:17:08.215584 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.215553 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" event={"ID":"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc","Type":"ContainerStarted","Data":"e2fa2a00eb65c83f084f443163a11bcd4399f7c5ae92505b5ccf85124d5a6362"} Jul 16 00:17:08.215706 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.215618 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" event={"ID":"aaa70c0e-3e53-4bf9-8f6c-f44bf8f275dc","Type":"ContainerStarted","Data":"7501b52ca6b107b3ec24cccdc952c975c0d589ecfcdb3d7f60936fc4883769a6"} Jul 16 00:17:08.245217 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.245165 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-79f68b9f4f-2mbts" podStartSLOduration=2.245149657 podStartE2EDuration="2.245149657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:08.244564362 +0000 UTC m=+264.312427652" watchObservedRunningTime="2026-07-16 00:17:08.245149657 +0000 UTC m=+264.313012946" Jul 16 00:17:08.409510 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.409428 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:08.567979 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.567926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:08.669193 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.669157 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:08.767923 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.767889 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:08.869443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:08.869353 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:09.112507 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:09.112469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:09.112670 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:09.112585 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:09.112670 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:09.112632 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:17:09.112736 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:09.112702 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:13.112685455 +0000 UTC m=+269.180548729 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : secret "insights-runtime-extractor-tls" not found Jul 16 00:17:09.112736 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:09.112699 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:17:09.112736 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:09.112730 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:13.112723957 +0000 UTC m=+269.180587227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : configmap "kube-rbac-proxy" not found Jul 16 00:17:09.202833 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:09.202738 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:09.203312 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:09.203295 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ln44r_8711c01b-c938-4538-8c1d-608395be7031/node-ca/0.log" Jul 16 00:17:10.204512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:10.204484 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xl2bf_bfc590a9-0257-4e81-8ae1-13d8be2b7098/serve-healthcheck-canary/0.log" Jul 16 00:17:10.215916 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:10.215885 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:10.405538 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:10.405454 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4xrmq_e509055a-d4bf-430e-97b9-d7e2b2833829/migrator/0.log" Jul 16 00:17:10.601080 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:10.601044 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:10.605718 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:10.605690 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4xrmq_e509055a-d4bf-430e-97b9-d7e2b2833829/graceful-termination/0.log" Jul 16 00:17:10.801978 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:10.801933 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:10.887719 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:10.887684 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:11.012483 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:11.012450 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:11.209351 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:11.209244 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:11.995814 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:11.995763 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:12.096622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:12.096578 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:12.200353 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:12.200291 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:12.601105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:12.601074 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:12.799236 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:12.799200 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:12.996003 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:12.995957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:13.146557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:13.146507 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:13.146763 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:13.146529 2557 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 16 00:17:13.146763 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:13.146673 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:13.146763 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:13.146717 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:21.146695429 +0000 UTC m=+277.214558707 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : configmap "kube-rbac-proxy" not found Jul 16 00:17:13.146933 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:13.146782 2557 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 16 00:17:13.146933 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:13.146853 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls podName:32f297a0-6414-4518-b18e-908d867d4926 nodeName:}" failed. No retries permitted until 2026-07-16 00:17:21.14683479 +0000 UTC m=+277.214698076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lqlwt" (UID: "32f297a0-6414-4518-b18e-908d867d4926") : secret "insights-runtime-extractor-tls" not found Jul 16 00:17:13.203893 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:13.203801 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:14.000398 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:14.000358 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:14.219350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:14.219315 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:14.594238 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:14.594202 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:14.657720 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:14.657687 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:14.800683 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:14.800648 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:14.995879 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:14.995827 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:15.402150 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:15.402048 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:15.972355 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:15.972317 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:15.972535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:15.972365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:15.972535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:15.972462 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:15.973138 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:15.973110 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f06db588-0616-4879-966d-9abe1add02e6-service-ca-bundle\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:15.974732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:15.974702 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f06db588-0616-4879-966d-9abe1add02e6-metrics-certs\") pod \"router-default-774b4878-z7tnc\" (UID: \"f06db588-0616-4879-966d-9abe1add02e6\") " pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:15.974832 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:15.974744 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d947280c-42ee-4fea-a2a9-bec881864104-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-hprns\" (UID: \"d947280c-42ee-4fea-a2a9-bec881864104\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:16.004205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.004166 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:16.051128 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.051097 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" Jul 16 00:17:16.067172 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.067132 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:16.187703 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.187671 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns"] Jul 16 00:17:16.191388 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:16.191360 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd947280c_42ee_4fea_a2a9_bec881864104.slice/crio-f17627e61145c38e1bb3e02a1bbf91a50073e5af33c20fe5fcc5b3b422d54528 WatchSource:0}: Error finding container f17627e61145c38e1bb3e02a1bbf91a50073e5af33c20fe5fcc5b3b422d54528: Status 404 returned error can't find the container with id f17627e61145c38e1bb3e02a1bbf91a50073e5af33c20fe5fcc5b3b422d54528 Jul 16 00:17:16.207383 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.207352 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-774b4878-z7tnc"] Jul 16 00:17:16.209896 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:16.209869 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf06db588_0616_4879_966d_9abe1add02e6.slice/crio-a1d588425f507a84475c86367967a3479eb33176ecb464476543dd4605dc2ab4 WatchSource:0}: Error finding container a1d588425f507a84475c86367967a3479eb33176ecb464476543dd4605dc2ab4: Status 404 returned error can't find the container with id a1d588425f507a84475c86367967a3479eb33176ecb464476543dd4605dc2ab4 Jul 16 00:17:16.240104 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.240074 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-774b4878-z7tnc" event={"ID":"f06db588-0616-4879-966d-9abe1add02e6","Type":"ContainerStarted","Data":"a1d588425f507a84475c86367967a3479eb33176ecb464476543dd4605dc2ab4"} Jul 16 00:17:16.241066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.241042 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" event={"ID":"d947280c-42ee-4fea-a2a9-bec881864104","Type":"ContainerStarted","Data":"f17627e61145c38e1bb3e02a1bbf91a50073e5af33c20fe5fcc5b3b422d54528"} Jul 16 00:17:16.398281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.398241 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:16.803548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.803511 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:16.997347 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:16.997313 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:17.246356 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:17.246321 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-774b4878-z7tnc" event={"ID":"f06db588-0616-4879-966d-9abe1add02e6","Type":"ContainerStarted","Data":"edfc29673d99f6408faf3aeea0ff21604df69735791548344b4bbd1c90783ba1"} Jul 16 00:17:17.271382 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:17.271275 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-774b4878-z7tnc" podStartSLOduration=17.27124061 podStartE2EDuration="17.27124061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:17.269338445 +0000 UTC m=+273.337201734" watchObservedRunningTime="2026-07-16 00:17:17.27124061 +0000 UTC m=+273.339103894" Jul 16 00:17:17.398464 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:17.398430 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:17.579829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:17.579732 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:17.996284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:17.996242 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:18.068007 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.067980 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:18.070518 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.070499 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:18.193070 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.193035 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:18.251693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.251573 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" event={"ID":"d947280c-42ee-4fea-a2a9-bec881864104","Type":"ContainerStarted","Data":"bf9bf41e6536f2a0c928333e3a37f5da56e6d2983e4d09b71521f667443c58dd"} Jul 16 00:17:18.251867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.251731 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:18.252948 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.252928 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-774b4878-z7tnc" Jul 16 00:17:18.270021 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.269956 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-hprns" podStartSLOduration=16.460945702 podStartE2EDuration="18.269941485s" totalImagesPullingTime="1.808995783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:18.26922533 +0000 UTC m=+274.337088619" watchObservedRunningTime="2026-07-16 00:17:18.269941485 +0000 UTC m=+274.337804772" Jul 16 00:17:18.342352 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.342314 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:18.440632 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.440598 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:18.540802 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.540699 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:18.798009 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:18.797911 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:19.203745 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:19.203659 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:20.883434 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:20.883404 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:20.985541 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:20.985490 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:21.220260 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.220182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:21.220260 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.220253 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:21.220782 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.220756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/32f297a0-6414-4518-b18e-908d867d4926-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:21.222393 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.222374 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/32f297a0-6414-4518-b18e-908d867d4926-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lqlwt\" (UID: \"32f297a0-6414-4518-b18e-908d867d4926\") " pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:21.330651 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.330610 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lqlwt" Jul 16 00:17:21.468872 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.468847 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lqlwt"] Jul 16 00:17:21.471571 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:21.471509 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32f297a0_6414_4518_b18e_908d867d4926.slice/crio-a05e119ff9e1968bb7247601efb1712cb7062cfb2f43dedcdc04dae338f930f2 WatchSource:0}: Error finding container a05e119ff9e1968bb7247601efb1712cb7062cfb2f43dedcdc04dae338f930f2: Status 404 returned error can't find the container with id a05e119ff9e1968bb7247601efb1712cb7062cfb2f43dedcdc04dae338f930f2 Jul 16 00:17:21.758138 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.758105 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:21.812157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:21.812112 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:22.266049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:22.266015 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlwt" event={"ID":"32f297a0-6414-4518-b18e-908d867d4926","Type":"ContainerStarted","Data":"a05e119ff9e1968bb7247601efb1712cb7062cfb2f43dedcdc04dae338f930f2"} Jul 16 00:17:24.948350 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:24.948283 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" podUID="2349fdd8-9fb4-4277-bf29-4119d44e9997" Jul 16 00:17:24.948350 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:24.948283 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" Jul 16 00:17:24.948350 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:24.948308 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-8c8t6" podUID="5731da3f-fd39-4944-a7b0-ecc6b88bbccd" Jul 16 00:17:25.276587 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:25.276554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8c8t6" Jul 16 00:17:25.276778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:25.276602 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:17:25.276778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:25.276567 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:17:26.906142 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:26.906106 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj"] Jul 16 00:17:26.909116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:26.909092 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" Jul 16 00:17:26.912031 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:26.911817 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 16 00:17:26.912874 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:26.912852 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4hvhk\"" Jul 16 00:17:26.919895 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:26.919864 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj"] Jul 16 00:17:27.073030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.072994 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.079368 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.079339 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8ccd9ccf-db6b-4c35-9148-f94d5b9a7972-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sfqpj\" (UID: \"8ccd9ccf-db6b-4c35-9148-f94d5b9a7972\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" Jul 16 00:17:27.180164 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.180077 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8ccd9ccf-db6b-4c35-9148-f94d5b9a7972-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sfqpj\" (UID: \"8ccd9ccf-db6b-4c35-9148-f94d5b9a7972\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" Jul 16 00:17:27.181399 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.181342 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.183365 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.183339 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8ccd9ccf-db6b-4c35-9148-f94d5b9a7972-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-sfqpj\" (UID: \"8ccd9ccf-db6b-4c35-9148-f94d5b9a7972\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" Jul 16 00:17:27.222121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.222086 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" Jul 16 00:17:27.272847 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.272767 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.287267 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.287237 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlwt" event={"ID":"32f297a0-6414-4518-b18e-908d867d4926","Type":"ContainerStarted","Data":"a668d30f54243e39daa5edcc116475004cae6d1fd3bd68fadf4cf7338117fed7"} Jul 16 00:17:27.358538 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.357369 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.391675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.391639 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj"] Jul 16 00:17:27.395293 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:27.395259 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ccd9ccf_db6b_4c35_9148_f94d5b9a7972.slice/crio-b4376a388f2b940e21ebb74e3c7a4be1993fcac8c54eabe44bfa8b6feeb33b9a WatchSource:0}: Error finding container b4376a388f2b940e21ebb74e3c7a4be1993fcac8c54eabe44bfa8b6feeb33b9a: Status 404 returned error can't find the container with id b4376a388f2b940e21ebb74e3c7a4be1993fcac8c54eabe44bfa8b6feeb33b9a Jul 16 00:17:27.460420 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.460329 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.526573 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.526503 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.582482 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.582438 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.683194 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.683157 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.800892 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.800858 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.901531 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.901494 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:27.956850 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:27.956818 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:28.071372 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.071276 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:28.140538 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.140494 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:28.291340 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.291305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:17:28.291533 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.291362 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:17:28.291533 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.291401 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:17:28.293029 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.292928 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" event={"ID":"8ccd9ccf-db6b-4c35-9148-f94d5b9a7972","Type":"ContainerStarted","Data":"b4376a388f2b940e21ebb74e3c7a4be1993fcac8c54eabe44bfa8b6feeb33b9a"} Jul 16 00:17:28.294243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.294217 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5731da3f-fd39-4944-a7b0-ecc6b88bbccd-metrics-tls\") pod \"dns-default-8c8t6\" (UID: \"5731da3f-fd39-4944-a7b0-ecc6b88bbccd\") " pod="openshift-dns/dns-default-8c8t6" Jul 16 00:17:28.294345 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.294282 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"image-registry-59bf9ccdd7-7q8rc\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:17:28.294345 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.294302 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2349fdd8-9fb4-4277-bf29-4119d44e9997-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-gvm7j\" (UID: \"2349fdd8-9fb4-4277-bf29-4119d44e9997\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:17:28.301447 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.301420 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:28.581620 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.581573 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-djqcn\"" Jul 16 00:17:28.581809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.581573 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-cws9t\"" Jul 16 00:17:28.581809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.581574 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-2vrt7\"" Jul 16 00:17:28.587836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.587808 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" Jul 16 00:17:28.588034 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.587840 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:17:28.588034 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.587949 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8c8t6" Jul 16 00:17:28.927543 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:28.927465 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:29.103524 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:29.103484 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:29.283224 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:29.283191 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:30.276764 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.276698 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-59bf9ccdd7-7q8rc"] Jul 16 00:17:30.279692 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:30.279657 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4186df4d_9f2d_47a8_871f_5bbe96398daa.slice/crio-33f5b24165db817bc1971c45f091817437563516c117c13b2536d56016c278ab WatchSource:0}: Error finding container 33f5b24165db817bc1971c45f091817437563516c117c13b2536d56016c278ab: Status 404 returned error can't find the container with id 33f5b24165db817bc1971c45f091817437563516c117c13b2536d56016c278ab Jul 16 00:17:30.291516 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.291494 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-gvm7j"] Jul 16 00:17:30.293955 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:30.293881 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2349fdd8_9fb4_4277_bf29_4119d44e9997.slice/crio-760e811063209b8245fa461c24a4c9ea3697b2048d37f75bfebfb74736efd64c WatchSource:0}: Error finding container 760e811063209b8245fa461c24a4c9ea3697b2048d37f75bfebfb74736efd64c: Status 404 returned error can't find the container with id 760e811063209b8245fa461c24a4c9ea3697b2048d37f75bfebfb74736efd64c Jul 16 00:17:30.301269 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.301245 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" event={"ID":"2349fdd8-9fb4-4277-bf29-4119d44e9997","Type":"ContainerStarted","Data":"760e811063209b8245fa461c24a4c9ea3697b2048d37f75bfebfb74736efd64c"} Jul 16 00:17:30.302580 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.302561 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" event={"ID":"8ccd9ccf-db6b-4c35-9148-f94d5b9a7972","Type":"ContainerStarted","Data":"beb7e8a6c54fe8e5352aff234f2943b274abf49486f05e9aa2aac259e9de38d1"} Jul 16 00:17:30.302738 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.302699 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" Jul 16 00:17:30.304260 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.304233 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlwt" event={"ID":"32f297a0-6414-4518-b18e-908d867d4926","Type":"ContainerStarted","Data":"43b7e340edc3144ebd9b5d2b52f118e16ea1c95eed8668e1a07e2fc234187a90"} Jul 16 00:17:30.305431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.305252 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" event={"ID":"4186df4d-9f2d-47a8-871f-5bbe96398daa","Type":"ContainerStarted","Data":"33f5b24165db817bc1971c45f091817437563516c117c13b2536d56016c278ab"} Jul 16 00:17:30.307548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.307530 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" Jul 16 00:17:30.319385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.319349 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-sfqpj" podStartSLOduration=1.610253873 podStartE2EDuration="4.319338239s" totalImagesPullingTime="2.709084366s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:30.318447278 +0000 UTC m=+286.386310565" watchObservedRunningTime="2026-07-16 00:17:30.319338239 +0000 UTC m=+286.387201531" Jul 16 00:17:30.342272 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.342238 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:30.417985 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.417930 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:30.487627 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.487590 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8c8t6"] Jul 16 00:17:30.490523 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:30.490499 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5731da3f_fd39_4944_a7b0_ecc6b88bbccd.slice/crio-213e1037052a5a6a4d832510347b6f30e47a6e7d5d08e69be9dfb6f94dfb4eed WatchSource:0}: Error finding container 213e1037052a5a6a4d832510347b6f30e47a6e7d5d08e69be9dfb6f94dfb4eed: Status 404 returned error can't find the container with id 213e1037052a5a6a4d832510347b6f30e47a6e7d5d08e69be9dfb6f94dfb4eed Jul 16 00:17:30.548350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.548262 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:30.570777 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.570738 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2v897"] Jul 16 00:17:30.575789 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.575769 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.578781 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.578753 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 16 00:17:30.578781 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.578766 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 16 00:17:30.579004 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.578875 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sstq5\"" Jul 16 00:17:30.579075 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.579003 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 16 00:17:30.582973 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.582941 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2v897"] Jul 16 00:17:30.612480 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.612444 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:30.711620 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.711576 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdfsj\" (UniqueName: \"kubernetes.io/projected/96c0eca8-9253-4d39-8244-bfb54c7718f8-kube-api-access-xdfsj\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.711826 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.711641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c0eca8-9253-4d39-8244-bfb54c7718f8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.711826 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.711701 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c0eca8-9253-4d39-8244-bfb54c7718f8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.711826 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.711753 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96c0eca8-9253-4d39-8244-bfb54c7718f8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.797224 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.797130 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:30.813164 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.813088 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdfsj\" (UniqueName: \"kubernetes.io/projected/96c0eca8-9253-4d39-8244-bfb54c7718f8-kube-api-access-xdfsj\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.813164 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.813124 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c0eca8-9253-4d39-8244-bfb54c7718f8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.813375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.813314 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c0eca8-9253-4d39-8244-bfb54c7718f8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.813483 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.813457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96c0eca8-9253-4d39-8244-bfb54c7718f8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.814098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.814069 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/96c0eca8-9253-4d39-8244-bfb54c7718f8-metrics-client-ca\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.816052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.816018 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/96c0eca8-9253-4d39-8244-bfb54c7718f8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.816162 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.816137 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/96c0eca8-9253-4d39-8244-bfb54c7718f8-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.822236 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.822213 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdfsj\" (UniqueName: \"kubernetes.io/projected/96c0eca8-9253-4d39-8244-bfb54c7718f8-kube-api-access-xdfsj\") pod \"prometheus-operator-64785b6675-2v897\" (UID: \"96c0eca8-9253-4d39-8244-bfb54c7718f8\") " pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:30.886102 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:30.886070 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" Jul 16 00:17:31.039103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:31.039020 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-2v897"] Jul 16 00:17:31.048925 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:31.048874 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96c0eca8_9253_4d39_8244_bfb54c7718f8.slice/crio-c89ba223aa0a1e623af3a3a4d20c076189d96473f5aef78c0e9976b101d78826 WatchSource:0}: Error finding container c89ba223aa0a1e623af3a3a4d20c076189d96473f5aef78c0e9976b101d78826: Status 404 returned error can't find the container with id c89ba223aa0a1e623af3a3a4d20c076189d96473f5aef78c0e9976b101d78826 Jul 16 00:17:31.312424 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:31.312242 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" event={"ID":"4186df4d-9f2d-47a8-871f-5bbe96398daa","Type":"ContainerStarted","Data":"d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730"} Jul 16 00:17:31.312900 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:31.312644 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:17:31.314373 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:31.314311 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8c8t6" event={"ID":"5731da3f-fd39-4944-a7b0-ecc6b88bbccd","Type":"ContainerStarted","Data":"213e1037052a5a6a4d832510347b6f30e47a6e7d5d08e69be9dfb6f94dfb4eed"} Jul 16 00:17:31.316373 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:31.316119 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" event={"ID":"96c0eca8-9253-4d39-8244-bfb54c7718f8","Type":"ContainerStarted","Data":"c89ba223aa0a1e623af3a3a4d20c076189d96473f5aef78c0e9976b101d78826"} Jul 16 00:17:31.339715 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:31.339651 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" podStartSLOduration=287.339633822 podStartE2EDuration="4m47.339633822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:31.338639647 +0000 UTC m=+287.406502932" watchObservedRunningTime="2026-07-16 00:17:31.339633822 +0000 UTC m=+287.407497109" Jul 16 00:17:32.323252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:32.323214 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" event={"ID":"2349fdd8-9fb4-4277-bf29-4119d44e9997","Type":"ContainerStarted","Data":"47e915a1a17ebc765defcba28143937ae3a07e0d779de99581025b0f658c22e8"} Jul 16 00:17:32.344648 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:32.344595 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-gvm7j" podStartSLOduration=273.870667767 podStartE2EDuration="4m35.344578029s" totalImagesPullingTime="1.473910262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:12:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:32.34331743 +0000 UTC m=+288.411180740" watchObservedRunningTime="2026-07-16 00:17:32.344578029 +0000 UTC m=+288.412441317" Jul 16 00:17:32.442331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:32.442285 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:32.504603 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:32.504564 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:34.896486 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:34.896390 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:35.335554 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.335509 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" event={"ID":"96c0eca8-9253-4d39-8244-bfb54c7718f8","Type":"ContainerStarted","Data":"432307f8f4f35011fbbc8eda459306efd4a2fa435651736837ebebf3cc387c1b"} Jul 16 00:17:35.335762 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.335575 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" event={"ID":"96c0eca8-9253-4d39-8244-bfb54c7718f8","Type":"ContainerStarted","Data":"9875c622f7fe387bcf2720028973085668879bd3bd8682f1471b9243e909b313"} Jul 16 00:17:35.337423 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.337393 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8c8t6" event={"ID":"5731da3f-fd39-4944-a7b0-ecc6b88bbccd","Type":"ContainerStarted","Data":"48fbc22ca2a695151fd2a874714a287efb86c4d9b682b8b99bdff3a6141e2072"} Jul 16 00:17:35.337565 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.337444 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8c8t6" event={"ID":"5731da3f-fd39-4944-a7b0-ecc6b88bbccd","Type":"ContainerStarted","Data":"f01190853ab76fcb6f2515e564cbe78e48601f52cbfec894ed9ddce263220318"} Jul 16 00:17:35.337565 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.337487 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8c8t6" Jul 16 00:17:35.339401 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.339380 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lqlwt" event={"ID":"32f297a0-6414-4518-b18e-908d867d4926","Type":"ContainerStarted","Data":"08d19d7ae54d5d20bc20c110be82d647d27c6af8893f6687b35a05818520e1df"} Jul 16 00:17:35.353207 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.353165 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-2v897" podStartSLOduration=1.806948491 podStartE2EDuration="5.353149522s" totalImagesPullingTime="3.546201031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:35.352323046 +0000 UTC m=+291.420186333" watchObservedRunningTime="2026-07-16 00:17:35.353149522 +0000 UTC m=+291.421012810" Jul 16 00:17:35.370396 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.370349 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lqlwt" podStartSLOduration=17.378942822 podStartE2EDuration="30.370333775s" totalImagesPullingTime="12.991390953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:17:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:35.369849658 +0000 UTC m=+291.437712946" watchObservedRunningTime="2026-07-16 00:17:35.370333775 +0000 UTC m=+291.438197062" Jul 16 00:17:35.388512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:35.388456 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-8c8t6" podStartSLOduration=253.28562453 podStartE2EDuration="4m17.388440149s" totalImagesPullingTime="4.102815619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:13:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:35.386869712 +0000 UTC m=+291.454733007" watchObservedRunningTime="2026-07-16 00:17:35.388440149 +0000 UTC m=+291.456303436" Jul 16 00:17:36.656723 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.656689 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:36.869405 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.869366 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:36.907253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.907164 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ntbqj"] Jul 16 00:17:36.914837 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.914808 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.917747 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.917726 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 16 00:17:36.917871 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.917811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2h5dm\"" Jul 16 00:17:36.918052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.918033 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 16 00:17:36.918940 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.918845 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 16 00:17:36.966917 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.966887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-metrics-client-ca\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967096 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.966927 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967096 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.966953 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-root\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967096 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.967033 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-sys\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967096 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.967065 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-textfile\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967096 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.967085 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-tls\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.967123 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.967193 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-wtmp\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.967256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rqbv\" (UniqueName: \"kubernetes.io/projected/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-kube-api-access-4rqbv\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:36.967435 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:36.967367 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:37.029595 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.029559 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:37.068411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068377 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068424 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-wtmp\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068456 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rqbv\" (UniqueName: \"kubernetes.io/projected/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-kube-api-access-4rqbv\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068484 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-metrics-client-ca\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068501 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068520 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-root\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068586 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-root\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068616 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-sys\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068631 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-textfile\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068645 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-tls\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068645 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-wtmp\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.068877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.068704 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-sys\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.069123 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.069032 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-textfile\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.069123 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.069066 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-metrics-client-ca\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.069123 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.069083 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-accelerators-collector-config\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.070831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.070808 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-tls\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.070926 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.070837 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.077577 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.077549 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rqbv\" (UniqueName: \"kubernetes.io/projected/ec8b91fb-2650-4ea2-bb38-e0933fe512dc-kube-api-access-4rqbv\") pod \"node-exporter-ntbqj\" (UID: \"ec8b91fb-2650-4ea2-bb38-e0933fe512dc\") " pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.130045 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.130011 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:37.226801 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.226714 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ntbqj" Jul 16 00:17:37.255001 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.254955 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:37.264214 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:37.264186 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec8b91fb_2650_4ea2_bb38_e0933fe512dc.slice/crio-3e409ad8dc42b26c4877e462085d5adce59e793184f49fc569a0acd8e6899bfb WatchSource:0}: Error finding container 3e409ad8dc42b26c4877e462085d5adce59e793184f49fc569a0acd8e6899bfb: Status 404 returned error can't find the container with id 3e409ad8dc42b26c4877e462085d5adce59e793184f49fc569a0acd8e6899bfb Jul 16 00:17:37.347443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.347412 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntbqj" event={"ID":"ec8b91fb-2650-4ea2-bb38-e0933fe512dc","Type":"ContainerStarted","Data":"3e409ad8dc42b26c4877e462085d5adce59e793184f49fc569a0acd8e6899bfb"} Jul 16 00:17:37.700446 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.700409 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:37.884777 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.884713 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:37.962121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:37.962011 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:38.081386 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.081347 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:38.182416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.182370 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:38.881839 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.881803 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77584cdf4-xnqpl"] Jul 16 00:17:38.885188 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.885173 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.887941 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.887916 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-elbl8mskehab1\"" Jul 16 00:17:38.888078 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.887929 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 16 00:17:38.888078 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.887983 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 16 00:17:38.888078 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.888050 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 16 00:17:38.888078 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.888070 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-wgk6q\"" Jul 16 00:17:38.889209 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.889190 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 16 00:17:38.889319 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.889304 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 16 00:17:38.895310 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.895287 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77584cdf4-xnqpl"] Jul 16 00:17:38.985196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985161 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsk2r\" (UniqueName: \"kubernetes.io/projected/47b5c890-4b25-4faf-b410-571bfd8626e9-kube-api-access-bsk2r\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.985362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-tls\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.985362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985238 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47b5c890-4b25-4faf-b410-571bfd8626e9-metrics-client-ca\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.985362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985254 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-grpc-tls\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.985362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985314 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.985362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985357 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.985512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985376 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:38.985512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:38.985397 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.085819 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.085777 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.085819 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.085823 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.086053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.085845 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.086053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.085863 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.086053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.085888 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsk2r\" (UniqueName: \"kubernetes.io/projected/47b5c890-4b25-4faf-b410-571bfd8626e9-kube-api-access-bsk2r\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.086053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.085946 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-tls\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.086053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.085999 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47b5c890-4b25-4faf-b410-571bfd8626e9-metrics-client-ca\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.086053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.086024 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-grpc-tls\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.086801 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.086771 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47b5c890-4b25-4faf-b410-571bfd8626e9-metrics-client-ca\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.088521 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.088485 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.088623 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.088576 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.088815 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.088798 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-tls\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.088922 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.088903 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.088982 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.088917 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.089123 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.089104 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47b5c890-4b25-4faf-b410-571bfd8626e9-secret-grpc-tls\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.094173 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.094145 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsk2r\" (UniqueName: \"kubernetes.io/projected/47b5c890-4b25-4faf-b410-571bfd8626e9-kube-api-access-bsk2r\") pod \"thanos-querier-77584cdf4-xnqpl\" (UID: \"47b5c890-4b25-4faf-b410-571bfd8626e9\") " pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.194416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.194323 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:39.324373 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.324225 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77584cdf4-xnqpl"] Jul 16 00:17:39.326396 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:39.326365 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b5c890_4b25_4faf_b410_571bfd8626e9.slice/crio-201df72246b5c57a1c09226677c5998adc43e4d1193b58a9735b578cbd622093 WatchSource:0}: Error finding container 201df72246b5c57a1c09226677c5998adc43e4d1193b58a9735b578cbd622093: Status 404 returned error can't find the container with id 201df72246b5c57a1c09226677c5998adc43e4d1193b58a9735b578cbd622093 Jul 16 00:17:39.358044 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.358012 2557 generic.go:356] "Generic (PLEG): container finished" podID="ec8b91fb-2650-4ea2-bb38-e0933fe512dc" containerID="01f5a86eba19159646c51552bfe320ec1db58d2048295e6117ba56ace5e12884" exitCode=0 Jul 16 00:17:39.358164 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.358102 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntbqj" event={"ID":"ec8b91fb-2650-4ea2-bb38-e0933fe512dc","Type":"ContainerDied","Data":"01f5a86eba19159646c51552bfe320ec1db58d2048295e6117ba56ace5e12884"} Jul 16 00:17:39.359341 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.359325 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" event={"ID":"47b5c890-4b25-4faf-b410-571bfd8626e9","Type":"ContainerStarted","Data":"201df72246b5c57a1c09226677c5998adc43e4d1193b58a9735b578cbd622093"} Jul 16 00:17:39.377280 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:17:39.377253 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-lf7sl" podUID="60590034-ae94-403d-8bcd-0092f90dbbfe" Jul 16 00:17:39.877131 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.877097 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:39.977922 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:39.977874 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:40.041676 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:40.041640 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:40.126003 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:40.125954 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:40.366791 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:40.366756 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntbqj" event={"ID":"ec8b91fb-2650-4ea2-bb38-e0933fe512dc","Type":"ContainerStarted","Data":"4a7a263f3b8ecb7c39127d4b5ba171b659e0fcef48ebacdccf4b87fa0419c780"} Jul 16 00:17:40.366986 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:40.366810 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ntbqj" event={"ID":"ec8b91fb-2650-4ea2-bb38-e0933fe512dc","Type":"ContainerStarted","Data":"0667920a229ea15638eab2768d2c1eb3276de6a50e8c5cfe0a4f8df2367b1e2e"} Jul 16 00:17:40.389325 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:40.389274 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ntbqj" podStartSLOduration=3.261922283 podStartE2EDuration="4.389256397s" totalImagesPullingTime="1.065894585s" totalInitContainerRuntime="61.439529ms" isStatefulPod=true podCreationTimestamp="2026-07-16 00:17:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:40.387704505 +0000 UTC m=+296.455567794" watchObservedRunningTime="2026-07-16 00:17:40.389256397 +0000 UTC m=+296.457119702" Jul 16 00:17:40.535475 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:40.535435 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:40.774895 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:40.774854 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:41.674270 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.674235 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:41.687246 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.687218 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l"] Jul 16 00:17:41.690418 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.690399 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:41.692934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.692910 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-wfhdn\"" Jul 16 00:17:41.693071 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.692936 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 16 00:17:41.699526 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.699504 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l"] Jul 16 00:17:41.710657 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.710630 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jktsf\" (UniqueName: \"kubernetes.io/projected/a7fed17f-7940-40bb-ab6f-6868dca87cb3-kube-api-access-jktsf\") pod \"monitoring-plugin-5f68df7f58-q2z4l\" (UID: \"a7fed17f-7940-40bb-ab6f-6868dca87cb3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:41.710767 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.710691 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a7fed17f-7940-40bb-ab6f-6868dca87cb3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-q2z4l\" (UID: \"a7fed17f-7940-40bb-ab6f-6868dca87cb3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:41.774412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.774381 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:41.811663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.811629 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jktsf\" (UniqueName: \"kubernetes.io/projected/a7fed17f-7940-40bb-ab6f-6868dca87cb3-kube-api-access-jktsf\") pod \"monitoring-plugin-5f68df7f58-q2z4l\" (UID: \"a7fed17f-7940-40bb-ab6f-6868dca87cb3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:41.811813 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.811688 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a7fed17f-7940-40bb-ab6f-6868dca87cb3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-q2z4l\" (UID: \"a7fed17f-7940-40bb-ab6f-6868dca87cb3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:41.814001 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.813982 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a7fed17f-7940-40bb-ab6f-6868dca87cb3-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-q2z4l\" (UID: \"a7fed17f-7940-40bb-ab6f-6868dca87cb3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:41.819613 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.819574 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jktsf\" (UniqueName: \"kubernetes.io/projected/a7fed17f-7940-40bb-ab6f-6868dca87cb3-kube-api-access-jktsf\") pod \"monitoring-plugin-5f68df7f58-q2z4l\" (UID: \"a7fed17f-7940-40bb-ab6f-6868dca87cb3\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:41.872341 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.872307 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:41.999718 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:41.999686 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:42.120182 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:42.120159 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l"] Jul 16 00:17:42.122490 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:17:42.122463 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7fed17f_7940_40bb_ab6f_6868dca87cb3.slice/crio-d49bf1d0b289ebad9b151e45dca99595402cbedf309133204557eecd8c33dae6 WatchSource:0}: Error finding container d49bf1d0b289ebad9b151e45dca99595402cbedf309133204557eecd8c33dae6: Status 404 returned error can't find the container with id d49bf1d0b289ebad9b151e45dca99595402cbedf309133204557eecd8c33dae6 Jul 16 00:17:42.380323 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:42.380253 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" event={"ID":"47b5c890-4b25-4faf-b410-571bfd8626e9","Type":"ContainerStarted","Data":"2945535be5c70008f95bedd56a3690bf1f3f89d46b022593a50993ad68174e66"} Jul 16 00:17:42.380323 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:42.380311 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" event={"ID":"47b5c890-4b25-4faf-b410-571bfd8626e9","Type":"ContainerStarted","Data":"e585d42a8d82423043cd7fda28615db2721923b52593cebec15c1b9e79243b9d"} Jul 16 00:17:42.380552 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:42.380335 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" event={"ID":"47b5c890-4b25-4faf-b410-571bfd8626e9","Type":"ContainerStarted","Data":"e12c0a1ec9f1c26be88fb7752616ed2493206787afaeaebcfeaeb89faa0c9956"} Jul 16 00:17:42.380552 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:42.380359 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" event={"ID":"a7fed17f-7940-40bb-ab6f-6868dca87cb3","Type":"ContainerStarted","Data":"d49bf1d0b289ebad9b151e45dca99595402cbedf309133204557eecd8c33dae6"} Jul 16 00:17:43.115704 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:43.115606 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:43.386476 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:43.386377 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" event={"ID":"47b5c890-4b25-4faf-b410-571bfd8626e9","Type":"ContainerStarted","Data":"7659c9fb9633fd5334bda6d2358831a1c92360c54a9a10c0098e9c89ee7c9779"} Jul 16 00:17:43.386476 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:43.386448 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" event={"ID":"47b5c890-4b25-4faf-b410-571bfd8626e9","Type":"ContainerStarted","Data":"3b6d4176f79ebc23d703b678c182dbbd092c3f279b2b8771db55c98e7ead0a35"} Jul 16 00:17:43.386702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:43.386489 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" event={"ID":"47b5c890-4b25-4faf-b410-571bfd8626e9","Type":"ContainerStarted","Data":"1388e63bded80436804bedc4bb831368a64972271e4d5c34dcef908652867e56"} Jul 16 00:17:43.386702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:43.386644 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:43.414721 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:43.414654 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" podStartSLOduration=2.519729762 podStartE2EDuration="5.414631771s" totalImagesPullingTime="2.894902009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:43.41246681 +0000 UTC m=+299.480330157" watchObservedRunningTime="2026-07-16 00:17:43.414631771 +0000 UTC m=+299.482495061" Jul 16 00:17:43.924032 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:43.923923 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:44.025153 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.025120 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:44.306883 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.306853 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:17:44.307298 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.307018 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:17:44.311618 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.311599 2557 kubelet.go:1648] "Image garbage collection succeeded" Jul 16 00:17:44.390887 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.390718 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" event={"ID":"a7fed17f-7940-40bb-ab6f-6868dca87cb3","Type":"ContainerStarted","Data":"a22d5a894f50e841fe5537f888bd4c8283520b65b696e55343471d9319e8785f"} Jul 16 00:17:44.402951 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.391061 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:44.402951 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.395995 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" Jul 16 00:17:44.408226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:44.408175 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-q2z4l" podStartSLOduration=1.9322104709999999 podStartE2EDuration="3.408160501s" totalImagesPullingTime="1.47595003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:17:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:17:44.406413235 +0000 UTC m=+300.474276523" watchObservedRunningTime="2026-07-16 00:17:44.408160501 +0000 UTC m=+300.476023855" Jul 16 00:17:45.344254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:45.344222 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8c8t6" Jul 16 00:17:47.146579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:47.146541 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:48.586241 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:48.586202 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:48.592695 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:48.592649 2557 patch_prober.go:28] interesting pod/image-registry-59bf9ccdd7-7q8rc container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 00:17:48.592828 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:48.592706 2557 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:17:48.916561 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:48.916477 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:49.019717 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:49.019684 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59bf9ccdd7-7q8rc"] Jul 16 00:17:49.024207 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:49.024076 2557 patch_prober.go:28] interesting pod/image-registry-59bf9ccdd7-7q8rc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 16 00:17:49.024207 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:49.024142 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:17:49.151574 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:49.151535 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:49.253114 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:49.253083 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:49.313705 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:49.313668 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:49.396344 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:49.396318 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77584cdf4-xnqpl" Jul 16 00:17:54.378660 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:54.378624 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:17:54.476047 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:54.476009 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:54.575836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:54.575802 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:17:59.024362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:17:59.024332 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:18:01.126388 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:01.126355 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:01.667132 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:01.667090 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:01.767450 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:01.767417 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:02.330252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:02.330210 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:02.430457 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:02.430429 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:06.763728 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:06.763693 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:06.865470 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:06.865437 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:10.742238 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:10.742204 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:10.842267 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:10.842228 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:14.039956 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.039895 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" containerName="registry" containerID="cri-o://d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730" gracePeriod=30 Jul 16 00:18:14.291153 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.291096 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:18:14.383686 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383660 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-installation-pull-secrets\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.383813 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383703 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-certificates\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.383813 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383726 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-image-registry-private-configuration\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.383813 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383757 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.383813 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383798 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4186df4d-9f2d-47a8-871f-5bbe96398daa-ca-trust-extracted\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.384024 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383822 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zfj5l\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-kube-api-access-zfj5l\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.384024 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383861 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-bound-sa-token\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.384024 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.383923 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-trusted-ca\") pod \"4186df4d-9f2d-47a8-871f-5bbe96398daa\" (UID: \"4186df4d-9f2d-47a8-871f-5bbe96398daa\") " Jul 16 00:18:14.384172 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.384076 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:18:14.384226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.384181 2557 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-certificates\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.384497 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.384470 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:18:14.386342 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.386315 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:18:14.386474 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.386429 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-kube-api-access-zfj5l" (OuterVolumeSpecName: "kube-api-access-zfj5l") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "kube-api-access-zfj5l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:18:14.386474 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.386452 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:18:14.386589 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.386505 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:18:14.386589 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.386541 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:18:14.405501 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.405465 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4186df4d-9f2d-47a8-871f-5bbe96398daa-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4186df4d-9f2d-47a8-871f-5bbe96398daa" (UID: "4186df4d-9f2d-47a8-871f-5bbe96398daa"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:18:14.484758 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.484737 2557 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-installation-pull-secrets\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.484758 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.484758 2557 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4186df4d-9f2d-47a8-871f-5bbe96398daa-image-registry-private-configuration\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.484878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.484767 2557 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-registry-tls\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.484878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.484776 2557 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4186df4d-9f2d-47a8-871f-5bbe96398daa-ca-trust-extracted\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.484878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.484783 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zfj5l\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-kube-api-access-zfj5l\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.484878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.484791 2557 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4186df4d-9f2d-47a8-871f-5bbe96398daa-bound-sa-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.484878 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.484798 2557 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4186df4d-9f2d-47a8-871f-5bbe96398daa-trusted-ca\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:18:14.499397 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.499376 2557 generic.go:356] "Generic (PLEG): container finished" podID="4186df4d-9f2d-47a8-871f-5bbe96398daa" containerID="d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730" exitCode=0 Jul 16 00:18:14.499477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.499419 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" Jul 16 00:18:14.499477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.499445 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" event={"ID":"4186df4d-9f2d-47a8-871f-5bbe96398daa","Type":"ContainerDied","Data":"d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730"} Jul 16 00:18:14.499545 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.499482 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-59bf9ccdd7-7q8rc" event={"ID":"4186df4d-9f2d-47a8-871f-5bbe96398daa","Type":"ContainerDied","Data":"33f5b24165db817bc1971c45f091817437563516c117c13b2536d56016c278ab"} Jul 16 00:18:14.499545 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.499501 2557 scope.go:117] "RemoveContainer" containerID="d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730" Jul 16 00:18:14.507646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.507627 2557 scope.go:117] "RemoveContainer" containerID="d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730" Jul 16 00:18:14.507920 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:18:14.507903 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730\": container with ID starting with d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730 not found: ID does not exist" containerID="d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730" Jul 16 00:18:14.507992 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.507928 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730"} err="failed to get container status \"d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730\": rpc error: code = NotFound desc = could not find container \"d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730\": container with ID starting with d9d5a60ff2c88a6466c77dbd56f6a1205b409e8fe76ed8ff3b20c4cc6b53e730 not found: ID does not exist" Jul 16 00:18:14.520728 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.520709 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-59bf9ccdd7-7q8rc"] Jul 16 00:18:14.524452 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:14.524432 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-59bf9ccdd7-7q8rc"] Jul 16 00:18:16.383328 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:16.383285 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" path="/var/lib/kubelet/pods/4186df4d-9f2d-47a8-871f-5bbe96398daa/volumes" Jul 16 00:18:18.657572 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:18.657538 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:19.524352 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:19.524324 2557 generic.go:356] "Generic (PLEG): container finished" podID="d13762bc-4e13-4922-afe2-968150abdcc5" containerID="5209dc3d0a5daf55c58f10487cff8b180c284569e0560907d203a8ff10133e55" exitCode=0 Jul 16 00:18:19.524508 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:19.524401 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" event={"ID":"d13762bc-4e13-4922-afe2-968150abdcc5","Type":"ContainerDied","Data":"5209dc3d0a5daf55c58f10487cff8b180c284569e0560907d203a8ff10133e55"} Jul 16 00:18:19.524757 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:19.524729 2557 scope.go:117] "RemoveContainer" containerID="5209dc3d0a5daf55c58f10487cff8b180c284569e0560907d203a8ff10133e55" Jul 16 00:18:20.529430 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:20.529382 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-sgxdn" event={"ID":"d13762bc-4e13-4922-afe2-968150abdcc5","Type":"ContainerStarted","Data":"9655d4bdeaabd3d5243acc8905c64995df1fa261e3f26fd84b7ed3dc82694c29"} Jul 16 00:18:27.668531 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:27.668491 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:27.726141 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:27.726105 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:30.569926 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:30.569893 2557 generic.go:356] "Generic (PLEG): container finished" podID="05919e70-19c6-4b38-aa0d-b031cb6ca19e" containerID="813e1c54daf40c4cfe4ec22fb7a61971f41a7006b769b735caf167a5860bd7ec" exitCode=0 Jul 16 00:18:30.570361 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:30.569945 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" event={"ID":"05919e70-19c6-4b38-aa0d-b031cb6ca19e","Type":"ContainerDied","Data":"813e1c54daf40c4cfe4ec22fb7a61971f41a7006b769b735caf167a5860bd7ec"} Jul 16 00:18:30.570361 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:30.570231 2557 scope.go:117] "RemoveContainer" containerID="813e1c54daf40c4cfe4ec22fb7a61971f41a7006b769b735caf167a5860bd7ec" Jul 16 00:18:31.575498 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:31.575468 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-wfgpj" event={"ID":"05919e70-19c6-4b38-aa0d-b031cb6ca19e","Type":"ContainerStarted","Data":"be6331c6efd8f8ef6ce6d4ab268eb6e6832de36b388636332d23a22b0192224d"} Jul 16 00:18:36.775355 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:36.775262 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:36.874622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:36.874591 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:56.249141 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:56.249078 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:56.568976 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:56.568862 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:57.216149 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:57.216104 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:18:57.218411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:57.218383 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60590034-ae94-403d-8bcd-0092f90dbbfe-metrics-certs\") pod \"network-metrics-daemon-lf7sl\" (UID: \"60590034-ae94-403d-8bcd-0092f90dbbfe\") " pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:18:57.382757 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:57.382722 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ct92c\"" Jul 16 00:18:57.390196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:57.390170 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-lf7sl" Jul 16 00:18:57.535599 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:57.535569 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-lf7sl"] Jul 16 00:18:57.538501 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:18:57.538470 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60590034_ae94_403d_8bcd_0092f90dbbfe.slice/crio-583c2c64c1a319ec5483198fd81981320e20d0524cbdc3e197e006a7467479ad WatchSource:0}: Error finding container 583c2c64c1a319ec5483198fd81981320e20d0524cbdc3e197e006a7467479ad: Status 404 returned error can't find the container with id 583c2c64c1a319ec5483198fd81981320e20d0524cbdc3e197e006a7467479ad Jul 16 00:18:57.540492 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:57.540470 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:18:57.677979 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:57.677934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf7sl" event={"ID":"60590034-ae94-403d-8bcd-0092f90dbbfe","Type":"ContainerStarted","Data":"583c2c64c1a319ec5483198fd81981320e20d0524cbdc3e197e006a7467479ad"} Jul 16 00:18:59.689542 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:59.689503 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf7sl" event={"ID":"60590034-ae94-403d-8bcd-0092f90dbbfe","Type":"ContainerStarted","Data":"c1e7c00f5e64d394eb18402e2e0f56cd4c70714cab36d945817046e04f863e76"} Jul 16 00:18:59.690047 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:59.689553 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-lf7sl" event={"ID":"60590034-ae94-403d-8bcd-0092f90dbbfe","Type":"ContainerStarted","Data":"bd50f7171f670b8613d8bd860fe29d0d6526689093b23cfa03daa0dee9547f02"} Jul 16 00:18:59.707067 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:59.707010 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-lf7sl" podStartSLOduration=374.508831879 podStartE2EDuration="6m15.706988968s" totalImagesPullingTime="1.198157089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:12:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:18:59.706601382 +0000 UTC m=+375.774464672" watchObservedRunningTime="2026-07-16 00:18:59.706988968 +0000 UTC m=+375.774852256" Jul 16 00:18:59.881561 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:59.881527 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:18:59.982052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:18:59.982016 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:19:05.346046 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:19:05.346009 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:19:05.489908 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:19:05.489876 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:19:05.963185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:19:05.963151 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:19:06.063518 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:19:06.063489 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:19:16.600249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:19:16.600196 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:19:16.667181 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:19:16.667148 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:19:16.738351 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:19:16.738311 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:01.722103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:01.722063 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:11.538926 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:11.538888 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:11.613169 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:11.613138 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:15.402317 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:15.402278 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:15.461812 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:15.461777 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:23.444114 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:23.444078 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:23.496640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:23.496595 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:26.843127 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:26.843086 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:26.956350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:26.956314 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:27.046323 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:27.046284 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:36.787010 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:36.786949 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:36.886408 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:36.886364 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:20:37.213475 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:20:37.213375 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:16.035779 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:16.035739 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:16.135702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:16.135666 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:18.945622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.945589 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn"] Jul 16 00:21:18.946047 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.945883 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" containerName="registry" Jul 16 00:21:18.946047 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.945893 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" containerName="registry" Jul 16 00:21:18.946047 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.945957 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="4186df4d-9f2d-47a8-871f-5bbe96398daa" containerName="registry" Jul 16 00:21:18.948943 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.948926 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:18.951897 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.951861 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 00:21:18.952934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.952912 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 00:21:18.953091 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.952953 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9zt5r\"" Jul 16 00:21:18.961126 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:18.961106 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn"] Jul 16 00:21:19.005722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.005688 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.005895 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.005728 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.005895 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.005777 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qfqk\" (UniqueName: \"kubernetes.io/projected/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-kube-api-access-7qfqk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.106525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.106492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.106525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.106528 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.106679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.106565 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qfqk\" (UniqueName: \"kubernetes.io/projected/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-kube-api-access-7qfqk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.106892 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.106872 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.106930 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.106894 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.114697 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.114676 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qfqk\" (UniqueName: \"kubernetes.io/projected/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-kube-api-access-7qfqk\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.259244 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.259218 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:19.389101 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:19.389069 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn"] Jul 16 00:21:19.392429 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:21:19.392401 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d7ebfa6_eda1_47db_aec0_6214a6b25c39.slice/crio-e593e431816cce06f873daba38c8470e1ae8a29fde5e53c8c3fa1904a03c4416 WatchSource:0}: Error finding container e593e431816cce06f873daba38c8470e1ae8a29fde5e53c8c3fa1904a03c4416: Status 404 returned error can't find the container with id e593e431816cce06f873daba38c8470e1ae8a29fde5e53c8c3fa1904a03c4416 Jul 16 00:21:20.140339 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:20.140298 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:20.220738 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:20.220694 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" event={"ID":"5d7ebfa6-eda1-47db-aec0-6214a6b25c39","Type":"ContainerStarted","Data":"e593e431816cce06f873daba38c8470e1ae8a29fde5e53c8c3fa1904a03c4416"} Jul 16 00:21:28.254831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:28.254794 2557 generic.go:356] "Generic (PLEG): container finished" podID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerID="45a39e9306769d4f37401e7cab03e77849de44ddba80ab4024d7fdf6cd17ee05" exitCode=0 Jul 16 00:21:28.255251 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:28.254868 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" event={"ID":"5d7ebfa6-eda1-47db-aec0-6214a6b25c39","Type":"ContainerDied","Data":"45a39e9306769d4f37401e7cab03e77849de44ddba80ab4024d7fdf6cd17ee05"} Jul 16 00:21:28.450074 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:28.450042 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:31.269042 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:31.269004 2557 generic.go:356] "Generic (PLEG): container finished" podID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerID="f3cb13b1954af8ce68fb78ab9963b24fc55ab824c07e554ee2b32ac9ded3f091" exitCode=0 Jul 16 00:21:31.269462 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:31.269095 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" event={"ID":"5d7ebfa6-eda1-47db-aec0-6214a6b25c39","Type":"ContainerDied","Data":"f3cb13b1954af8ce68fb78ab9963b24fc55ab824c07e554ee2b32ac9ded3f091"} Jul 16 00:21:40.308107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:40.308032 2557 generic.go:356] "Generic (PLEG): container finished" podID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerID="269e16219d5492bce7ce937fdaf75c05772a6a932cf46f4446a62a1ff60c61fe" exitCode=0 Jul 16 00:21:40.308107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:40.308079 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" event={"ID":"5d7ebfa6-eda1-47db-aec0-6214a6b25c39","Type":"ContainerDied","Data":"269e16219d5492bce7ce937fdaf75c05772a6a932cf46f4446a62a1ff60c61fe"} Jul 16 00:21:41.463567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.463527 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:41.587030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.586911 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7qfqk\" (UniqueName: \"kubernetes.io/projected/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-kube-api-access-7qfqk\") pod \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " Jul 16 00:21:41.587030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.587006 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-util\") pod \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " Jul 16 00:21:41.587289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.587086 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-bundle\") pod \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\" (UID: \"5d7ebfa6-eda1-47db-aec0-6214a6b25c39\") " Jul 16 00:21:41.587849 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.587823 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-bundle" (OuterVolumeSpecName: "bundle") pod "5d7ebfa6-eda1-47db-aec0-6214a6b25c39" (UID: "5d7ebfa6-eda1-47db-aec0-6214a6b25c39"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:21:41.589158 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.589129 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-kube-api-access-7qfqk" (OuterVolumeSpecName: "kube-api-access-7qfqk") pod "5d7ebfa6-eda1-47db-aec0-6214a6b25c39" (UID: "5d7ebfa6-eda1-47db-aec0-6214a6b25c39"). InnerVolumeSpecName "kube-api-access-7qfqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:21:41.591692 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.591669 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-util" (OuterVolumeSpecName: "util") pod "5d7ebfa6-eda1-47db-aec0-6214a6b25c39" (UID: "5d7ebfa6-eda1-47db-aec0-6214a6b25c39"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:21:41.688509 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.688472 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7qfqk\" (UniqueName: \"kubernetes.io/projected/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-kube-api-access-7qfqk\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:21:41.688509 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.688502 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-util\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:21:41.688509 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:41.688513 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5d7ebfa6-eda1-47db-aec0-6214a6b25c39-bundle\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:21:42.318202 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:42.318168 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" event={"ID":"5d7ebfa6-eda1-47db-aec0-6214a6b25c39","Type":"ContainerDied","Data":"e593e431816cce06f873daba38c8470e1ae8a29fde5e53c8c3fa1904a03c4416"} Jul 16 00:21:42.318437 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:42.318213 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bgkmn" Jul 16 00:21:42.318437 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:42.318215 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e593e431816cce06f873daba38c8470e1ae8a29fde5e53c8c3fa1904a03c4416" Jul 16 00:21:45.105643 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:45.105597 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:46.558689 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:46.558649 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:47.471833 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.471799 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm"] Jul 16 00:21:47.472148 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.472133 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerName="util" Jul 16 00:21:47.472201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.472151 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerName="util" Jul 16 00:21:47.472201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.472171 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerName="pull" Jul 16 00:21:47.472201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.472176 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerName="pull" Jul 16 00:21:47.472201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.472186 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerName="extract" Jul 16 00:21:47.472201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.472192 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerName="extract" Jul 16 00:21:47.472349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.472239 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d7ebfa6-eda1-47db-aec0-6214a6b25c39" containerName="extract" Jul 16 00:21:47.474324 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.474309 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.478134 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.478113 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 16 00:21:47.478284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.478188 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:21:47.478284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.478192 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4cplm\"" Jul 16 00:21:47.504660 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.504630 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm"] Jul 16 00:21:47.539326 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.539288 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7fzf\" (UniqueName: \"kubernetes.io/projected/63eb2de0-d4cc-438c-b0dc-c4e35cabb733-kube-api-access-h7fzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-v6vrm\" (UID: \"63eb2de0-d4cc-438c-b0dc-c4e35cabb733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.539326 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.539329 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63eb2de0-d4cc-438c-b0dc-c4e35cabb733-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v6vrm\" (UID: \"63eb2de0-d4cc-438c-b0dc-c4e35cabb733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.639903 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.639868 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7fzf\" (UniqueName: \"kubernetes.io/projected/63eb2de0-d4cc-438c-b0dc-c4e35cabb733-kube-api-access-h7fzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-v6vrm\" (UID: \"63eb2de0-d4cc-438c-b0dc-c4e35cabb733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.639903 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.639908 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63eb2de0-d4cc-438c-b0dc-c4e35cabb733-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v6vrm\" (UID: \"63eb2de0-d4cc-438c-b0dc-c4e35cabb733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.640429 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.640288 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/63eb2de0-d4cc-438c-b0dc-c4e35cabb733-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-v6vrm\" (UID: \"63eb2de0-d4cc-438c-b0dc-c4e35cabb733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.653318 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.653291 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7fzf\" (UniqueName: \"kubernetes.io/projected/63eb2de0-d4cc-438c-b0dc-c4e35cabb733-kube-api-access-h7fzf\") pod \"cert-manager-operator-controller-manager-55c444bf86-v6vrm\" (UID: \"63eb2de0-d4cc-438c-b0dc-c4e35cabb733\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.783458 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.783421 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" Jul 16 00:21:47.922253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:47.922220 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm"] Jul 16 00:21:47.926134 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:21:47.926108 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63eb2de0_d4cc_438c_b0dc_c4e35cabb733.slice/crio-f7f3dc5ef4d3e9fbefa8ec2a7f650295aaf70feb7a1062c897fa0c121337ca97 WatchSource:0}: Error finding container f7f3dc5ef4d3e9fbefa8ec2a7f650295aaf70feb7a1062c897fa0c121337ca97: Status 404 returned error can't find the container with id f7f3dc5ef4d3e9fbefa8ec2a7f650295aaf70feb7a1062c897fa0c121337ca97 Jul 16 00:21:48.341532 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:48.341495 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" event={"ID":"63eb2de0-d4cc-438c-b0dc-c4e35cabb733","Type":"ContainerStarted","Data":"f7f3dc5ef4d3e9fbefa8ec2a7f650295aaf70feb7a1062c897fa0c121337ca97"} Jul 16 00:21:48.922583 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:48.922545 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:49.023420 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:49.023379 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:50.352910 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:50.352872 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" event={"ID":"63eb2de0-d4cc-438c-b0dc-c4e35cabb733","Type":"ContainerStarted","Data":"602e30f250ae1dcb290a3ae5efa2c345f211805242f78d71f878e341a78c4c55"} Jul 16 00:21:50.380256 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:50.380205 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-v6vrm" podStartSLOduration=1.912805343 podStartE2EDuration="3.380186176s" totalImagesPullingTime="1.467380833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:21:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:21:50.377594882 +0000 UTC m=+546.445458170" watchObservedRunningTime="2026-07-16 00:21:50.380186176 +0000 UTC m=+546.448049467" Jul 16 00:21:50.785824 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:50.785781 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:50.888583 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:50.888544 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:51.195103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.195019 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:51.299433 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.299394 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:51.463261 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.463181 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn"] Jul 16 00:21:51.466681 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.466664 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.469342 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.469323 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 00:21:51.469342 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.469326 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 00:21:51.469504 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.469397 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9zt5r\"" Jul 16 00:21:51.479289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.479269 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn"] Jul 16 00:21:51.571864 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.571824 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlcz\" (UniqueName: \"kubernetes.io/projected/d8460b83-06db-4f75-83e2-076888bcf18b-kube-api-access-7vlcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.571864 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.571867 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.572094 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.571898 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.672615 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.672575 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.672785 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.672625 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.672785 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.672681 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlcz\" (UniqueName: \"kubernetes.io/projected/d8460b83-06db-4f75-83e2-076888bcf18b-kube-api-access-7vlcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.673038 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.673016 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.673038 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.673029 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.682883 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.682858 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlcz\" (UniqueName: \"kubernetes.io/projected/d8460b83-06db-4f75-83e2-076888bcf18b-kube-api-access-7vlcz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.775140 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.775103 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:51.904024 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:51.903948 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn"] Jul 16 00:21:51.906674 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:21:51.906648 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8460b83_06db_4f75_83e2_076888bcf18b.slice/crio-08eeb7f5873dfa41805bb918cd5f6ce64cb0e1338e27ddb57ab751d9337077ae WatchSource:0}: Error finding container 08eeb7f5873dfa41805bb918cd5f6ce64cb0e1338e27ddb57ab751d9337077ae: Status 404 returned error can't find the container with id 08eeb7f5873dfa41805bb918cd5f6ce64cb0e1338e27ddb57ab751d9337077ae Jul 16 00:21:52.362087 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:52.362052 2557 generic.go:356] "Generic (PLEG): container finished" podID="d8460b83-06db-4f75-83e2-076888bcf18b" containerID="59e559614f4bda680eba6ee4d510e897b70b8828c0b83be7a297765b6217eafe" exitCode=0 Jul 16 00:21:52.362275 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:52.362144 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" event={"ID":"d8460b83-06db-4f75-83e2-076888bcf18b","Type":"ContainerDied","Data":"59e559614f4bda680eba6ee4d510e897b70b8828c0b83be7a297765b6217eafe"} Jul 16 00:21:52.362275 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:52.362198 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" event={"ID":"d8460b83-06db-4f75-83e2-076888bcf18b","Type":"ContainerStarted","Data":"08eeb7f5873dfa41805bb918cd5f6ce64cb0e1338e27ddb57ab751d9337077ae"} Jul 16 00:21:53.509743 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:53.509700 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:53.718523 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:53.718481 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:54.603030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.603000 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8"] Jul 16 00:21:54.606160 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.606144 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:54.608892 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.608862 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 16 00:21:54.609055 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.608889 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-t8hjn\"" Jul 16 00:21:54.609055 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.608903 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 16 00:21:54.614664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.614630 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8"] Jul 16 00:21:54.698157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.698058 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0827ad-24e4-46f0-a6ca-68732c810822-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hgjm8\" (UID: \"ad0827ad-24e4-46f0-a6ca-68732c810822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:54.698157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.698106 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ch2s2\" (UniqueName: \"kubernetes.io/projected/ad0827ad-24e4-46f0-a6ca-68732c810822-kube-api-access-ch2s2\") pod \"cert-manager-cainjector-559cdd8c87-hgjm8\" (UID: \"ad0827ad-24e4-46f0-a6ca-68732c810822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:54.799463 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.799422 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0827ad-24e4-46f0-a6ca-68732c810822-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hgjm8\" (UID: \"ad0827ad-24e4-46f0-a6ca-68732c810822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:54.799644 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.799469 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ch2s2\" (UniqueName: \"kubernetes.io/projected/ad0827ad-24e4-46f0-a6ca-68732c810822-kube-api-access-ch2s2\") pod \"cert-manager-cainjector-559cdd8c87-hgjm8\" (UID: \"ad0827ad-24e4-46f0-a6ca-68732c810822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:54.807772 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.807734 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ad0827ad-24e4-46f0-a6ca-68732c810822-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-hgjm8\" (UID: \"ad0827ad-24e4-46f0-a6ca-68732c810822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:54.807909 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.807740 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ch2s2\" (UniqueName: \"kubernetes.io/projected/ad0827ad-24e4-46f0-a6ca-68732c810822-kube-api-access-ch2s2\") pod \"cert-manager-cainjector-559cdd8c87-hgjm8\" (UID: \"ad0827ad-24e4-46f0-a6ca-68732c810822\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:54.930224 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:54.930185 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" Jul 16 00:21:55.067502 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:55.067473 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8"] Jul 16 00:21:55.070041 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:21:55.070014 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad0827ad_24e4_46f0_a6ca_68732c810822.slice/crio-cb3c4460b833982a4280fcd5969f0378784663a7bb1229753066636f6fed3cad WatchSource:0}: Error finding container cb3c4460b833982a4280fcd5969f0378784663a7bb1229753066636f6fed3cad: Status 404 returned error can't find the container with id cb3c4460b833982a4280fcd5969f0378784663a7bb1229753066636f6fed3cad Jul 16 00:21:55.378795 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:55.378756 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" event={"ID":"ad0827ad-24e4-46f0-a6ca-68732c810822","Type":"ContainerStarted","Data":"cb3c4460b833982a4280fcd5969f0378784663a7bb1229753066636f6fed3cad"} Jul 16 00:21:55.380498 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:55.380478 2557 generic.go:356] "Generic (PLEG): container finished" podID="d8460b83-06db-4f75-83e2-076888bcf18b" containerID="f81f19b00edad63c1caa9c52f24fc5d5e9d8605607bfa36d6111c203664db355" exitCode=0 Jul 16 00:21:55.380616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:55.380536 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" event={"ID":"d8460b83-06db-4f75-83e2-076888bcf18b","Type":"ContainerDied","Data":"f81f19b00edad63c1caa9c52f24fc5d5e9d8605607bfa36d6111c203664db355"} Jul 16 00:21:55.914647 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:55.914604 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:56.017917 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:56.017886 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:21:56.388276 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:56.388238 2557 generic.go:356] "Generic (PLEG): container finished" podID="d8460b83-06db-4f75-83e2-076888bcf18b" containerID="5ad59cff42e11a81ec91ec54551fe1f3d6b78c5b67f3ab080a9f9ed5dd030b42" exitCode=0 Jul 16 00:21:56.388462 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:56.388322 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" event={"ID":"d8460b83-06db-4f75-83e2-076888bcf18b","Type":"ContainerDied","Data":"5ad59cff42e11a81ec91ec54551fe1f3d6b78c5b67f3ab080a9f9ed5dd030b42"} Jul 16 00:21:57.971940 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:57.971901 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:58.126513 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.126471 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-util\") pod \"d8460b83-06db-4f75-83e2-076888bcf18b\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " Jul 16 00:21:58.126513 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.126516 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-bundle\") pod \"d8460b83-06db-4f75-83e2-076888bcf18b\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " Jul 16 00:21:58.126698 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.126566 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vlcz\" (UniqueName: \"kubernetes.io/projected/d8460b83-06db-4f75-83e2-076888bcf18b-kube-api-access-7vlcz\") pod \"d8460b83-06db-4f75-83e2-076888bcf18b\" (UID: \"d8460b83-06db-4f75-83e2-076888bcf18b\") " Jul 16 00:21:58.126942 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.126901 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-bundle" (OuterVolumeSpecName: "bundle") pod "d8460b83-06db-4f75-83e2-076888bcf18b" (UID: "d8460b83-06db-4f75-83e2-076888bcf18b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:21:58.128714 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.128691 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8460b83-06db-4f75-83e2-076888bcf18b-kube-api-access-7vlcz" (OuterVolumeSpecName: "kube-api-access-7vlcz") pod "d8460b83-06db-4f75-83e2-076888bcf18b" (UID: "d8460b83-06db-4f75-83e2-076888bcf18b"). InnerVolumeSpecName "kube-api-access-7vlcz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:21:58.132345 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.132318 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-util" (OuterVolumeSpecName: "util") pod "d8460b83-06db-4f75-83e2-076888bcf18b" (UID: "d8460b83-06db-4f75-83e2-076888bcf18b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:21:58.228144 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.228053 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-util\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:21:58.228144 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.228083 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d8460b83-06db-4f75-83e2-076888bcf18b-bundle\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:21:58.228144 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.228097 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vlcz\" (UniqueName: \"kubernetes.io/projected/d8460b83-06db-4f75-83e2-076888bcf18b-kube-api-access-7vlcz\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:21:58.405281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.405248 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" event={"ID":"ad0827ad-24e4-46f0-a6ca-68732c810822","Type":"ContainerStarted","Data":"fc6885d4575cae5f0dae50c00987babfe35f14d9176843beae0482159f63b073"} Jul 16 00:21:58.407548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.407525 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" Jul 16 00:21:58.407687 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.407556 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fkjhkn" event={"ID":"d8460b83-06db-4f75-83e2-076888bcf18b","Type":"ContainerDied","Data":"08eeb7f5873dfa41805bb918cd5f6ce64cb0e1338e27ddb57ab751d9337077ae"} Jul 16 00:21:58.407687 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.407621 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="08eeb7f5873dfa41805bb918cd5f6ce64cb0e1338e27ddb57ab751d9337077ae" Jul 16 00:21:58.428607 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:21:58.428553 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-hgjm8" podStartSLOduration=1.471138405 podStartE2EDuration="4.428537545s" totalImagesPullingTime="2.95739914s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:21:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:21:58.427873824 +0000 UTC m=+554.495737110" watchObservedRunningTime="2026-07-16 00:21:58.428537545 +0000 UTC m=+554.496400833" Jul 16 00:22:01.164618 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.164585 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:01.523383 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523351 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xnkss"] Jul 16 00:22:01.523666 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523654 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8460b83-06db-4f75-83e2-076888bcf18b" containerName="util" Jul 16 00:22:01.523722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523667 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8460b83-06db-4f75-83e2-076888bcf18b" containerName="util" Jul 16 00:22:01.523722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523689 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8460b83-06db-4f75-83e2-076888bcf18b" containerName="pull" Jul 16 00:22:01.523722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523694 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8460b83-06db-4f75-83e2-076888bcf18b" containerName="pull" Jul 16 00:22:01.523722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523700 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8460b83-06db-4f75-83e2-076888bcf18b" containerName="extract" Jul 16 00:22:01.523722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523705 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8460b83-06db-4f75-83e2-076888bcf18b" containerName="extract" Jul 16 00:22:01.523870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.523757 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8460b83-06db-4f75-83e2-076888bcf18b" containerName="extract" Jul 16 00:22:01.528614 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.528599 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.531093 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.531074 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-zzj8k\"" Jul 16 00:22:01.537147 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.537123 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xnkss"] Jul 16 00:22:01.655658 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.655624 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhp77\" (UniqueName: \"kubernetes.io/projected/1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6-kube-api-access-mhp77\") pod \"cert-manager-55b4d954d5-xnkss\" (UID: \"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6\") " pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.655867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.655699 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6-bound-sa-token\") pod \"cert-manager-55b4d954d5-xnkss\" (UID: \"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6\") " pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.756848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.756810 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6-bound-sa-token\") pod \"cert-manager-55b4d954d5-xnkss\" (UID: \"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6\") " pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.757037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.756858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhp77\" (UniqueName: \"kubernetes.io/projected/1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6-kube-api-access-mhp77\") pod \"cert-manager-55b4d954d5-xnkss\" (UID: \"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6\") " pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.766137 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.766100 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6-bound-sa-token\") pod \"cert-manager-55b4d954d5-xnkss\" (UID: \"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6\") " pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.766304 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.766270 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhp77\" (UniqueName: \"kubernetes.io/projected/1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6-kube-api-access-mhp77\") pod \"cert-manager-55b4d954d5-xnkss\" (UID: \"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6\") " pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.838199 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.838102 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-xnkss" Jul 16 00:22:01.977561 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:01.977520 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-xnkss"] Jul 16 00:22:01.980399 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:01.980372 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1950a3c7_957f_49c2_b5ca_ca8e2a9b4fe6.slice/crio-a6b7809d9648b7dfdc53e19f7a77ec4f57de5a38273d16ec1d0f9b3c28be4f0b WatchSource:0}: Error finding container a6b7809d9648b7dfdc53e19f7a77ec4f57de5a38273d16ec1d0f9b3c28be4f0b: Status 404 returned error can't find the container with id a6b7809d9648b7dfdc53e19f7a77ec4f57de5a38273d16ec1d0f9b3c28be4f0b Jul 16 00:22:02.426770 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:02.426731 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xnkss" event={"ID":"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6","Type":"ContainerStarted","Data":"3aaaa7d75172de6cd276355f17a936ac485ab7af96d1e993c62e93b81cb0ad26"} Jul 16 00:22:02.427201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:02.426785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-xnkss" event={"ID":"1950a3c7-957f-49c2-b5ca-ca8e2a9b4fe6","Type":"ContainerStarted","Data":"a6b7809d9648b7dfdc53e19f7a77ec4f57de5a38273d16ec1d0f9b3c28be4f0b"} Jul 16 00:22:02.445565 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:02.445518 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:02.447658 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:02.447603 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-xnkss" podStartSLOduration=1.447585093 podStartE2EDuration="1.447585093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:02.447155268 +0000 UTC m=+558.515018556" watchObservedRunningTime="2026-07-16 00:22:02.447585093 +0000 UTC m=+558.515448382" Jul 16 00:22:02.539817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:02.539780 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:02.722360 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:02.722261 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:09.214592 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:09.214550 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:09.317136 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:09.317098 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:11.236142 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:11.236102 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:12.030025 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.029982 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn"] Jul 16 00:22:12.032498 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.032473 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.035378 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.035351 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 16 00:22:12.036522 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.036502 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9zt5r\"" Jul 16 00:22:12.036622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.036501 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 16 00:22:12.042561 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.042532 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn"] Jul 16 00:22:12.142155 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.142119 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m428\" (UniqueName: \"kubernetes.io/projected/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-kube-api-access-9m428\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.142350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.142164 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.142350 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.142284 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.243229 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.243177 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.243229 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.243241 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m428\" (UniqueName: \"kubernetes.io/projected/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-kube-api-access-9m428\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.243664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.243265 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.243664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.243640 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.243753 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.243649 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.252162 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.252114 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m428\" (UniqueName: \"kubernetes.io/projected/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-kube-api-access-9m428\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.344163 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.344080 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:12.484509 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:12.484474 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn"] Jul 16 00:22:12.488169 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:12.488141 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode732cf7c_2331_4bd2_abd1_bb7b5326d2eb.slice/crio-92dbd7becc14315f63f01411d3e33ba03320ee7777fbb955c3988c2c4cd76259 WatchSource:0}: Error finding container 92dbd7becc14315f63f01411d3e33ba03320ee7777fbb955c3988c2c4cd76259: Status 404 returned error can't find the container with id 92dbd7becc14315f63f01411d3e33ba03320ee7777fbb955c3988c2c4cd76259 Jul 16 00:22:13.476455 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:13.476421 2557 generic.go:356] "Generic (PLEG): container finished" podID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerID="97c2cf7397a11f4fbc2a5b934153fab74a30cf2bb161b8901de06ca84ba94475" exitCode=0 Jul 16 00:22:13.476840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:13.476486 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" event={"ID":"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb","Type":"ContainerDied","Data":"97c2cf7397a11f4fbc2a5b934153fab74a30cf2bb161b8901de06ca84ba94475"} Jul 16 00:22:13.476840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:13.476529 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" event={"ID":"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb","Type":"ContainerStarted","Data":"92dbd7becc14315f63f01411d3e33ba03320ee7777fbb955c3988c2c4cd76259"} Jul 16 00:22:14.482839 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:14.482802 2557 generic.go:356] "Generic (PLEG): container finished" podID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerID="eeef4ac42fc6a35a780fc16c48bddbad75752814c821a5bb4eaac6091bd7c1f2" exitCode=0 Jul 16 00:22:14.483242 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:14.482861 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" event={"ID":"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb","Type":"ContainerDied","Data":"eeef4ac42fc6a35a780fc16c48bddbad75752814c821a5bb4eaac6091bd7c1f2"} Jul 16 00:22:15.194324 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:15.194283 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:15.489619 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:15.489582 2557 generic.go:356] "Generic (PLEG): container finished" podID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerID="98771167fbde6a51f692534a8e50a8d9c95a4710ad333dc6b36083a863ee32b8" exitCode=0 Jul 16 00:22:15.490015 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:15.489625 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" event={"ID":"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb","Type":"ContainerDied","Data":"98771167fbde6a51f692534a8e50a8d9c95a4710ad333dc6b36083a863ee32b8"} Jul 16 00:22:16.620571 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.620548 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:16.781601 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.781504 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-bundle\") pod \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " Jul 16 00:22:16.781601 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.781547 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-util\") pod \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " Jul 16 00:22:16.781601 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.781577 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9m428\" (UniqueName: \"kubernetes.io/projected/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-kube-api-access-9m428\") pod \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\" (UID: \"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb\") " Jul 16 00:22:16.782323 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.782295 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-bundle" (OuterVolumeSpecName: "bundle") pod "e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" (UID: "e732cf7c-2331-4bd2-abd1-bb7b5326d2eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:22:16.783679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.783651 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-kube-api-access-9m428" (OuterVolumeSpecName: "kube-api-access-9m428") pod "e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" (UID: "e732cf7c-2331-4bd2-abd1-bb7b5326d2eb"). InnerVolumeSpecName "kube-api-access-9m428". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:22:16.787148 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.787117 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-util" (OuterVolumeSpecName: "util") pod "e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" (UID: "e732cf7c-2331-4bd2-abd1-bb7b5326d2eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:22:16.882724 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.882692 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-bundle\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:22:16.882724 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.882718 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-util\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:22:16.882724 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:16.882727 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9m428\" (UniqueName: \"kubernetes.io/projected/e732cf7c-2331-4bd2-abd1-bb7b5326d2eb-kube-api-access-9m428\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:22:17.500844 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:17.500817 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" Jul 16 00:22:17.500844 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:17.500825 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7c7rn" event={"ID":"e732cf7c-2331-4bd2-abd1-bb7b5326d2eb","Type":"ContainerDied","Data":"92dbd7becc14315f63f01411d3e33ba03320ee7777fbb955c3988c2c4cd76259"} Jul 16 00:22:17.501079 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:17.500873 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92dbd7becc14315f63f01411d3e33ba03320ee7777fbb955c3988c2c4cd76259" Jul 16 00:22:23.312201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:23.312164 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:23.413147 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:23.413099 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:23.967244 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:23.967211 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.200052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.200010 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.302048 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.302009 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.341432 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341398 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp"] Jul 16 00:22:24.341829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341749 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerName="pull" Jul 16 00:22:24.341829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341762 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerName="pull" Jul 16 00:22:24.341829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341774 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerName="extract" Jul 16 00:22:24.341829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341779 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerName="extract" Jul 16 00:22:24.341829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341788 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerName="util" Jul 16 00:22:24.341829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341794 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerName="util" Jul 16 00:22:24.342078 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.341858 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="e732cf7c-2331-4bd2-abd1-bb7b5326d2eb" containerName="extract" Jul 16 00:22:24.345163 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.345145 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.347832 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.347811 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pzpg8\"" Jul 16 00:22:24.348132 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.348102 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 16 00:22:24.348261 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.348172 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 16 00:22:24.348261 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.348193 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 16 00:22:24.348261 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.348244 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 16 00:22:24.359865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.359835 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp"] Jul 16 00:22:24.444873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.444838 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36590293-402e-4d77-aa83-b702c3eb5cc5-tmp\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.444873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.444874 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36590293-402e-4d77-aa83-b702c3eb5cc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.445163 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.444913 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrb5l\" (UniqueName: \"kubernetes.io/projected/36590293-402e-4d77-aa83-b702c3eb5cc5-kube-api-access-nrb5l\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.445163 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.445070 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36590293-402e-4d77-aa83-b702c3eb5cc5-manifests\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.445163 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.445101 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36590293-402e-4d77-aa83-b702c3eb5cc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.459871 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.459839 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.545791 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.545756 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36590293-402e-4d77-aa83-b702c3eb5cc5-manifests\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.545791 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.545795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36590293-402e-4d77-aa83-b702c3eb5cc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.546043 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.545821 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36590293-402e-4d77-aa83-b702c3eb5cc5-tmp\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.546043 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.545838 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36590293-402e-4d77-aa83-b702c3eb5cc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.546043 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.545862 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrb5l\" (UniqueName: \"kubernetes.io/projected/36590293-402e-4d77-aa83-b702c3eb5cc5-kube-api-access-nrb5l\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.546255 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.546233 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/36590293-402e-4d77-aa83-b702c3eb5cc5-manifests\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.548356 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.548334 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/36590293-402e-4d77-aa83-b702c3eb5cc5-apiservice-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.548604 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.548584 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/36590293-402e-4d77-aa83-b702c3eb5cc5-tmp\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.548791 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.548777 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/36590293-402e-4d77-aa83-b702c3eb5cc5-webhook-cert\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.561262 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.561202 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrb5l\" (UniqueName: \"kubernetes.io/projected/36590293-402e-4d77-aa83-b702c3eb5cc5-kube-api-access-nrb5l\") pod \"opendatahub-operator-controller-manager-dd579ccfb-pk2gp\" (UID: \"36590293-402e-4d77-aa83-b702c3eb5cc5\") " pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.574044 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.574015 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.656828 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.656791 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:24.664015 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.663957 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.764709 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.764673 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.796841 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.796808 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp"] Jul 16 00:22:24.800318 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:24.800291 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36590293_402e_4d77_aa83_b702c3eb5cc5.slice/crio-b0b60be589e3574f316c074b0a630b3dda93a37237d720ba8808647ced392a00 WatchSource:0}: Error finding container b0b60be589e3574f316c074b0a630b3dda93a37237d720ba8808647ced392a00: Status 404 returned error can't find the container with id b0b60be589e3574f316c074b0a630b3dda93a37237d720ba8808647ced392a00 Jul 16 00:22:24.863642 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.863505 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:24.966119 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:24.966084 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:25.540353 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:25.540308 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" event={"ID":"36590293-402e-4d77-aa83-b702c3eb5cc5","Type":"ContainerStarted","Data":"b0b60be589e3574f316c074b0a630b3dda93a37237d720ba8808647ced392a00"} Jul 16 00:22:28.557835 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:28.557745 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" event={"ID":"36590293-402e-4d77-aa83-b702c3eb5cc5","Type":"ContainerStarted","Data":"f7f6197320f3b3e474fecf9149d7ee8c60d6f9148928b38b07a9f9f3e401f0d2"} Jul 16 00:22:29.563852 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:29.563817 2557 generic.go:356] "Generic (PLEG): container finished" podID="36590293-402e-4d77-aa83-b702c3eb5cc5" containerID="f7f6197320f3b3e474fecf9149d7ee8c60d6f9148928b38b07a9f9f3e401f0d2" exitCode=0 Jul 16 00:22:29.564266 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:29.563873 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" event={"ID":"36590293-402e-4d77-aa83-b702c3eb5cc5","Type":"ContainerDied","Data":"f7f6197320f3b3e474fecf9149d7ee8c60d6f9148928b38b07a9f9f3e401f0d2"} Jul 16 00:22:30.570022 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:30.569982 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" event={"ID":"36590293-402e-4d77-aa83-b702c3eb5cc5","Type":"ContainerStarted","Data":"f7c9096324b8dbd92ce87addd6a7874ed1c02acaabea39ad10331ab4534ccb11"} Jul 16 00:22:30.570469 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:30.570105 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:30.592755 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:30.592701 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" podStartSLOduration=1.703013318 podStartE2EDuration="6.592680831s" totalImagesPullingTime="3.8385552s" totalInitContainerRuntime="1.051112313s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:30.59129656 +0000 UTC m=+586.659159862" watchObservedRunningTime="2026-07-16 00:22:30.592680831 +0000 UTC m=+586.660544120" Jul 16 00:22:32.379281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:32.379246 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:32.478226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:32.478184 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:41.576917 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:41.576884 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-dd579ccfb-pk2gp" Jul 16 00:22:43.739253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:43.739213 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:43.879627 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:43.879585 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:44.341923 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.341895 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:22:44.342716 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.342688 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:22:44.416281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.416171 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:44.542785 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.542754 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb"] Jul 16 00:22:44.546153 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.546133 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.550159 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.550138 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 16 00:22:44.550651 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.550548 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 16 00:22:44.551611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.551595 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tmnrn\"" Jul 16 00:22:44.561185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.561163 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb"] Jul 16 00:22:44.613294 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.613210 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-tls-certs\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.613294 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.613245 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-445l8\" (UniqueName: \"kubernetes.io/projected/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-kube-api-access-445l8\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.613501 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.613376 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-tmp\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.626294 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.626267 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:44.645628 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.645600 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rgk4f"] Jul 16 00:22:44.648891 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.648874 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:44.651514 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.651495 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 16 00:22:44.651615 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.651521 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7lz6g\"" Jul 16 00:22:44.660667 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.660644 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rgk4f"] Jul 16 00:22:44.714497 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.714357 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-tmp\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.714497 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.714405 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-cert\") pod \"odh-model-controller-7998c67dc4-rgk4f\" (UID: \"8cdc0e39-12ba-48e8-ab22-bd3468c089d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:44.714497 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.714463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-tls-certs\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.714497 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.714492 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-445l8\" (UniqueName: \"kubernetes.io/projected/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-kube-api-access-445l8\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.714835 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.714549 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwdbf\" (UniqueName: \"kubernetes.io/projected/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-kube-api-access-zwdbf\") pod \"odh-model-controller-7998c67dc4-rgk4f\" (UID: \"8cdc0e39-12ba-48e8-ab22-bd3468c089d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:44.717228 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.717195 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-tmp\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.717537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.717514 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-tls-certs\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.723094 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.723071 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-445l8\" (UniqueName: \"kubernetes.io/projected/d42cab0b-d8aa-4e79-99a6-09f72246cbd5-kube-api-access-445l8\") pod \"kube-auth-proxy-76b5c6c765-5d2rb\" (UID: \"d42cab0b-d8aa-4e79-99a6-09f72246cbd5\") " pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.723774 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.723739 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:44.816139 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.816102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-cert\") pod \"odh-model-controller-7998c67dc4-rgk4f\" (UID: \"8cdc0e39-12ba-48e8-ab22-bd3468c089d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:44.816592 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.816180 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwdbf\" (UniqueName: \"kubernetes.io/projected/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-kube-api-access-zwdbf\") pod \"odh-model-controller-7998c67dc4-rgk4f\" (UID: \"8cdc0e39-12ba-48e8-ab22-bd3468c089d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:44.816592 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:22:44.816279 2557 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 16 00:22:44.816592 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:22:44.816367 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-cert podName:8cdc0e39-12ba-48e8-ab22-bd3468c089d2 nodeName:}" failed. No retries permitted until 2026-07-16 00:22:45.316346624 +0000 UTC m=+601.384209896 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-cert") pod "odh-model-controller-7998c67dc4-rgk4f" (UID: "8cdc0e39-12ba-48e8-ab22-bd3468c089d2") : secret "odh-model-controller-webhook-cert" not found Jul 16 00:22:44.826338 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.826288 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:44.828332 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.828305 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwdbf\" (UniqueName: \"kubernetes.io/projected/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-kube-api-access-zwdbf\") pod \"odh-model-controller-7998c67dc4-rgk4f\" (UID: \"8cdc0e39-12ba-48e8-ab22-bd3468c089d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:44.855946 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.855918 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" Jul 16 00:22:44.939514 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:44.939485 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:45.000101 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.000029 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb"] Jul 16 00:22:45.002689 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:45.002655 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd42cab0b_d8aa_4e79_99a6_09f72246cbd5.slice/crio-7627505530ab15f80575a3126c65674d08d8f52275e2bea0b3c43ff3a648ab50 WatchSource:0}: Error finding container 7627505530ab15f80575a3126c65674d08d8f52275e2bea0b3c43ff3a648ab50: Status 404 returned error can't find the container with id 7627505530ab15f80575a3126c65674d08d8f52275e2bea0b3c43ff3a648ab50 Jul 16 00:22:45.117085 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.117053 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:45.320805 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.320769 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-cert\") pod \"odh-model-controller-7998c67dc4-rgk4f\" (UID: \"8cdc0e39-12ba-48e8-ab22-bd3468c089d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:45.323178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.323151 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8cdc0e39-12ba-48e8-ab22-bd3468c089d2-cert\") pod \"odh-model-controller-7998c67dc4-rgk4f\" (UID: \"8cdc0e39-12ba-48e8-ab22-bd3468c089d2\") " pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:45.559328 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.559297 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:45.644597 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.644559 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" event={"ID":"d42cab0b-d8aa-4e79-99a6-09f72246cbd5","Type":"ContainerStarted","Data":"7627505530ab15f80575a3126c65674d08d8f52275e2bea0b3c43ff3a648ab50"} Jul 16 00:22:45.644764 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.644625 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2kdsh"] Jul 16 00:22:45.648249 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.648229 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:45.655553 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.655424 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-s2566\"" Jul 16 00:22:45.655553 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.655524 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 16 00:22:45.664567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.664176 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2kdsh"] Jul 16 00:22:45.688115 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.688026 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:45.724360 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.724328 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623e2dc9-a29c-4ffb-81b2-8357375e7001-tls-certs\") pod \"model-serving-api-54d89bd5fc-2kdsh\" (UID: \"623e2dc9-a29c-4ffb-81b2-8357375e7001\") " pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:45.724614 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.724374 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq9fg\" (UniqueName: \"kubernetes.io/projected/623e2dc9-a29c-4ffb-81b2-8357375e7001-kube-api-access-jq9fg\") pod \"model-serving-api-54d89bd5fc-2kdsh\" (UID: \"623e2dc9-a29c-4ffb-81b2-8357375e7001\") " pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:45.745371 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.745347 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-rgk4f"] Jul 16 00:22:45.747920 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:45.747895 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdc0e39_12ba_48e8_ab22_bd3468c089d2.slice/crio-4e732a711d906c45b884dad176f2d067c63365daaafb4e565a3f415c6bafbd5b WatchSource:0}: Error finding container 4e732a711d906c45b884dad176f2d067c63365daaafb4e565a3f415c6bafbd5b: Status 404 returned error can't find the container with id 4e732a711d906c45b884dad176f2d067c63365daaafb4e565a3f415c6bafbd5b Jul 16 00:22:45.788262 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.788224 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:45.825369 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.825233 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623e2dc9-a29c-4ffb-81b2-8357375e7001-tls-certs\") pod \"model-serving-api-54d89bd5fc-2kdsh\" (UID: \"623e2dc9-a29c-4ffb-81b2-8357375e7001\") " pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:45.825369 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.825283 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq9fg\" (UniqueName: \"kubernetes.io/projected/623e2dc9-a29c-4ffb-81b2-8357375e7001-kube-api-access-jq9fg\") pod \"model-serving-api-54d89bd5fc-2kdsh\" (UID: \"623e2dc9-a29c-4ffb-81b2-8357375e7001\") " pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:45.828133 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.828113 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/623e2dc9-a29c-4ffb-81b2-8357375e7001-tls-certs\") pod \"model-serving-api-54d89bd5fc-2kdsh\" (UID: \"623e2dc9-a29c-4ffb-81b2-8357375e7001\") " pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:45.839344 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.839296 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq9fg\" (UniqueName: \"kubernetes.io/projected/623e2dc9-a29c-4ffb-81b2-8357375e7001-kube-api-access-jq9fg\") pod \"model-serving-api-54d89bd5fc-2kdsh\" (UID: \"623e2dc9-a29c-4ffb-81b2-8357375e7001\") " pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:45.858336 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.858296 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:45.961884 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:45.961859 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:46.136705 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:46.136678 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-2kdsh"] Jul 16 00:22:46.138766 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:46.138735 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623e2dc9_a29c_4ffb_81b2_8357375e7001.slice/crio-2819cbca16abd6ead21975b60269b164609ff3cb5cd62f66b4b0a774795d54f2 WatchSource:0}: Error finding container 2819cbca16abd6ead21975b60269b164609ff3cb5cd62f66b4b0a774795d54f2: Status 404 returned error can't find the container with id 2819cbca16abd6ead21975b60269b164609ff3cb5cd62f66b4b0a774795d54f2 Jul 16 00:22:46.653082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:46.653045 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" event={"ID":"8cdc0e39-12ba-48e8-ab22-bd3468c089d2","Type":"ContainerStarted","Data":"4e732a711d906c45b884dad176f2d067c63365daaafb4e565a3f415c6bafbd5b"} Jul 16 00:22:46.654919 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:46.654891 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" event={"ID":"623e2dc9-a29c-4ffb-81b2-8357375e7001","Type":"ContainerStarted","Data":"2819cbca16abd6ead21975b60269b164609ff3cb5cd62f66b4b0a774795d54f2"} Jul 16 00:22:47.244757 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:47.244688 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:49.532404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.532365 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:49.674928 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.674892 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" event={"ID":"8cdc0e39-12ba-48e8-ab22-bd3468c089d2","Type":"ContainerStarted","Data":"bde655d579b016bd3cba14430bb352695e882bcb8df83387d9bb9e1d2d67bf6d"} Jul 16 00:22:49.675135 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.675012 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:22:49.676505 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.676479 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" event={"ID":"623e2dc9-a29c-4ffb-81b2-8357375e7001","Type":"ContainerStarted","Data":"261a99d2c5973f3bcbfebbac5da75ee28a74fa39212b480e2a0c327b32cb0a1c"} Jul 16 00:22:49.676622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.676522 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:22:49.677972 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.677937 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" event={"ID":"d42cab0b-d8aa-4e79-99a6-09f72246cbd5","Type":"ContainerStarted","Data":"095704ae63b92e3ffed67c752b818947d519359a1a74985a118ab6d52eb7a39b"} Jul 16 00:22:49.693240 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.693189 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" podStartSLOduration=1.8940614089999999 podStartE2EDuration="5.693169289s" totalImagesPullingTime="3.79910788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:49.693043336 +0000 UTC m=+605.760906650" watchObservedRunningTime="2026-07-16 00:22:49.693169289 +0000 UTC m=+605.761032578" Jul 16 00:22:49.713684 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.713629 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-76b5c6c765-5d2rb" podStartSLOduration=1.22812798 podStartE2EDuration="5.7136135s" totalImagesPullingTime="4.48548552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:49.711584847 +0000 UTC m=+605.779448154" watchObservedRunningTime="2026-07-16 00:22:49.7136135 +0000 UTC m=+605.781476789" Jul 16 00:22:49.734610 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.734560 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" podStartSLOduration=1.385389394 podStartE2EDuration="4.734544414s" totalImagesPullingTime="3.34915502s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:49.73378554 +0000 UTC m=+605.801648845" watchObservedRunningTime="2026-07-16 00:22:49.734544414 +0000 UTC m=+605.802407702" Jul 16 00:22:49.788624 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.788546 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq"] Jul 16 00:22:49.792533 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.792508 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.795389 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.795366 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 00:22:49.795520 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.795409 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-gc2l9\"" Jul 16 00:22:49.803916 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.803891 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq"] Jul 16 00:22:49.864446 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864414 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b107506-43b6-4565-9ca8-387ea6053bf1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864446 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864450 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864482 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864555 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twkmr\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-kube-api-access-twkmr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864596 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864616 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864642 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864696 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.864840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.864738 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.965910 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.965875 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966113 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.965932 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966113 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.965990 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twkmr\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-kube-api-access-twkmr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966113 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966020 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966202 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966263 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966271 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966305 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966317 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966343 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966397 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b107506-43b6-4565-9ca8-387ea6053bf1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966647 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966534 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966643 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.966950 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.966926 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b107506-43b6-4565-9ca8-387ea6053bf1-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.968566 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.968545 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.968739 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.968725 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.987523 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.987496 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:49.988917 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:49.988896 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twkmr\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-kube-api-access-twkmr\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-b2txq\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:50.104132 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:50.104043 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:50.242411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:50.242382 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq"] Jul 16 00:22:50.243115 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:50.243081 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b107506_43b6_4565_9ca8_387ea6053bf1.slice/crio-550e6083bdc9d52be829f46639ffdd83458bc9ead58aa1d9b8e125d60e37b278 WatchSource:0}: Error finding container 550e6083bdc9d52be829f46639ffdd83458bc9ead58aa1d9b8e125d60e37b278: Status 404 returned error can't find the container with id 550e6083bdc9d52be829f46639ffdd83458bc9ead58aa1d9b8e125d60e37b278 Jul 16 00:22:50.630182 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:50.630152 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:50.684698 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:50.684663 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" event={"ID":"5b107506-43b6-4565-9ca8-387ea6053bf1","Type":"ContainerStarted","Data":"550e6083bdc9d52be829f46639ffdd83458bc9ead58aa1d9b8e125d60e37b278"} Jul 16 00:22:52.959615 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:52.959558 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:22:52.959905 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:52.959657 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:22:52.959905 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:52.959689 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:22:53.051110 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.051076 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6"] Jul 16 00:22:53.054809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.054781 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.058947 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.058926 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-9jngr\"" Jul 16 00:22:53.060273 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.060233 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 16 00:22:53.060273 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.060269 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 16 00:22:53.060454 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.060291 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 16 00:22:53.060454 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.060238 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 16 00:22:53.060454 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.060293 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 16 00:22:53.070934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.070910 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6"] Jul 16 00:22:53.199986 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.199926 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5fadcee-706f-41e9-899c-fb5f4dc30599-manager-config\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.199986 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.199984 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5fadcee-706f-41e9-899c-fb5f4dc30599-cert\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.200230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.200052 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbqxl\" (UniqueName: \"kubernetes.io/projected/f5fadcee-706f-41e9-899c-fb5f4dc30599-kube-api-access-lbqxl\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.200230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.200097 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5fadcee-706f-41e9-899c-fb5f4dc30599-metrics-cert\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.300575 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.300542 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5fadcee-706f-41e9-899c-fb5f4dc30599-cert\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.300779 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.300617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbqxl\" (UniqueName: \"kubernetes.io/projected/f5fadcee-706f-41e9-899c-fb5f4dc30599-kube-api-access-lbqxl\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.300779 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.300650 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5fadcee-706f-41e9-899c-fb5f4dc30599-metrics-cert\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.300779 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.300707 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5fadcee-706f-41e9-899c-fb5f4dc30599-manager-config\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.301404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.301380 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f5fadcee-706f-41e9-899c-fb5f4dc30599-manager-config\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.303178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.303156 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f5fadcee-706f-41e9-899c-fb5f4dc30599-cert\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.303273 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.303183 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f5fadcee-706f-41e9-899c-fb5f4dc30599-metrics-cert\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.332311 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.332281 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbqxl\" (UniqueName: \"kubernetes.io/projected/f5fadcee-706f-41e9-899c-fb5f4dc30599-kube-api-access-lbqxl\") pod \"lws-controller-manager-58f9b8cc9c-mhpt6\" (UID: \"f5fadcee-706f-41e9-899c-fb5f4dc30599\") " pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.364535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.364512 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:53.533212 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.533170 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6"] Jul 16 00:22:53.538347 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:22:53.538305 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5fadcee_706f_41e9_899c_fb5f4dc30599.slice/crio-a1793fd3230aa4dca5b78ca8ff7dc50c638896dfcb5b5dc2914ae304cb8ebb22 WatchSource:0}: Error finding container a1793fd3230aa4dca5b78ca8ff7dc50c638896dfcb5b5dc2914ae304cb8ebb22: Status 404 returned error can't find the container with id a1793fd3230aa4dca5b78ca8ff7dc50c638896dfcb5b5dc2914ae304cb8ebb22 Jul 16 00:22:53.709030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.708892 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" event={"ID":"5b107506-43b6-4565-9ca8-387ea6053bf1","Type":"ContainerStarted","Data":"d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591"} Jul 16 00:22:53.710255 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:53.710232 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" event={"ID":"f5fadcee-706f-41e9-899c-fb5f4dc30599","Type":"ContainerStarted","Data":"a1793fd3230aa4dca5b78ca8ff7dc50c638896dfcb5b5dc2914ae304cb8ebb22"} Jul 16 00:22:54.104778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:54.104746 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:22:54.106323 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:54.106296 2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 16 00:22:54.106431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:54.106354 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 16 00:22:55.105243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.105204 2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 16 00:22:55.105727 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.105271 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 16 00:22:55.149148 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.149104 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:55.299372 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.299337 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:55.474756 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.474671 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:55.722330 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.722296 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" event={"ID":"f5fadcee-706f-41e9-899c-fb5f4dc30599","Type":"ContainerStarted","Data":"215ea7b2a47c4547b7f660e877cf96c0de61186ceb7a6bba342f0f0305699dc0"} Jul 16 00:22:55.722515 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.722389 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:22:55.761690 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.761640 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" podStartSLOduration=1.192802907 podStartE2EDuration="2.761622505s" totalImagesPullingTime="1.568819598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:55.759888988 +0000 UTC m=+611.827752278" watchObservedRunningTime="2026-07-16 00:22:55.761622505 +0000 UTC m=+611.829485794" Jul 16 00:22:55.762091 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:55.762067 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" podStartSLOduration=4.048047558 podStartE2EDuration="6.762056634s" totalImagesPullingTime="2.714009076s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:22:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:22:53.730777087 +0000 UTC m=+609.798640375" watchObservedRunningTime="2026-07-16 00:22:55.762056634 +0000 UTC m=+611.829919924" Jul 16 00:22:56.105100 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:56.105019 2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 16 00:22:56.105100 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:56.105071 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 16 00:22:56.526665 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:56.526601 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:56.642842 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:56.642803 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:56.739379 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:56.739346 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:22:57.104487 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:57.104453 2557 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" start-of-body= Jul 16 00:22:57.104657 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:57.104509 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.33:15021/healthz/ready\": dial tcp 10.132.0.33:15021: connect: connection refused" Jul 16 00:22:57.798097 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:57.798051 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq"] Jul 16 00:22:57.798573 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:22:57.798305 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" containerID="cri-o://d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591" gracePeriod=30 Jul 16 00:23:00.687267 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:00.687234 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-rgk4f" Jul 16 00:23:00.689506 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:00.689480 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-2kdsh" Jul 16 00:23:03.058595 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.058532 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:23:03.186475 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186432 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-data\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186475 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186479 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-credential-socket\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186528 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-socket\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186580 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-podinfo\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186608 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-certs\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186643 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twkmr\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-kube-api-access-twkmr\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186680 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b107506-43b6-4565-9ca8-387ea6053bf1-istiod-ca-cert\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186767 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-envoy\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186794 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-token\") pod \"5b107506-43b6-4565-9ca8-387ea6053bf1\" (UID: \"5b107506-43b6-4565-9ca8-387ea6053bf1\") " Jul 16 00:23:03.186988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186770 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-data" (OuterVolumeSpecName: "istio-data") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:23:03.186988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186834 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:23:03.186988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.186845 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:23:03.187253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.187013 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:23:03.187253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.187097 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.187253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.187115 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.187253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.187133 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.187253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.187153 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.187253 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.187133 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b107506-43b6-4565-9ca8-387ea6053bf1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:23:03.189155 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.189127 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:23:03.189342 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.189313 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-token" (OuterVolumeSpecName: "istio-token") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:23:03.189342 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.189324 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:23:03.189452 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.189370 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-kube-api-access-twkmr" (OuterVolumeSpecName: "kube-api-access-twkmr") pod "5b107506-43b6-4565-9ca8-387ea6053bf1" (UID: "5b107506-43b6-4565-9ca8-387ea6053bf1"). InnerVolumeSpecName "kube-api-access-twkmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:23:03.287830 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.287785 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twkmr\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-kube-api-access-twkmr\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.287830 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.287824 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5b107506-43b6-4565-9ca8-387ea6053bf1-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.287830 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.287835 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.287830 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.287844 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.288135 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.287851 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5b107506-43b6-4565-9ca8-387ea6053bf1-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:23:03.771588 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.771548 2557 generic.go:356] "Generic (PLEG): container finished" podID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerID="d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591" exitCode=0 Jul 16 00:23:03.771588 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.771593 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" Jul 16 00:23:03.771848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.771628 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" event={"ID":"5b107506-43b6-4565-9ca8-387ea6053bf1","Type":"ContainerDied","Data":"d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591"} Jul 16 00:23:03.771848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.771679 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq" event={"ID":"5b107506-43b6-4565-9ca8-387ea6053bf1","Type":"ContainerDied","Data":"550e6083bdc9d52be829f46639ffdd83458bc9ead58aa1d9b8e125d60e37b278"} Jul 16 00:23:03.771848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.771700 2557 scope.go:117] "RemoveContainer" containerID="d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591" Jul 16 00:23:03.781446 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.781427 2557 scope.go:117] "RemoveContainer" containerID="d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591" Jul 16 00:23:03.781730 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:23:03.781711 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591\": container with ID starting with d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591 not found: ID does not exist" containerID="d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591" Jul 16 00:23:03.781799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.781743 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591"} err="failed to get container status \"d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591\": rpc error: code = NotFound desc = could not find container \"d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591\": container with ID starting with d9adef8ee934e6c87bbbae4d44197933c24dc1515fb6481c9c39002f5ebf1591 not found: ID does not exist" Jul 16 00:23:03.794387 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.794360 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq"] Jul 16 00:23:03.797543 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:03.797521 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-b2txq"] Jul 16 00:23:04.384041 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:04.384009 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" path="/var/lib/kubelet/pods/5b107506-43b6-4565-9ca8-387ea6053bf1/volumes" Jul 16 00:23:06.729110 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:06.729017 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-58f9b8cc9c-mhpt6" Jul 16 00:23:22.108246 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:22.108212 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:35.610411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:35.610377 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:42.107175 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:42.107138 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:45.238100 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:45.238063 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:45.339225 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:45.339187 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:45.409294 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:45.409260 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:45.475224 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:45.475166 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:47.365212 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:47.365177 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:23:47.465668 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:23:47.465635 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:00.739789 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.739745 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss"] Jul 16 00:24:00.740294 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.740150 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" Jul 16 00:24:00.740294 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.740163 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" Jul 16 00:24:00.740294 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.740214 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="5b107506-43b6-4565-9ca8-387ea6053bf1" containerName="istio-proxy" Jul 16 00:24:00.744618 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.744601 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.747588 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.747565 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-95lhl\"" Jul 16 00:24:00.747588 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.747578 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 00:24:00.747588 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.747583 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 00:24:00.752186 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.752168 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss"] Jul 16 00:24:00.882573 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.882527 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.882766 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.882613 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j99dq\" (UniqueName: \"kubernetes.io/projected/c0938401-5843-4035-877c-14c1be081213-kube-api-access-j99dq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.882766 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.882643 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.983329 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.983296 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.983492 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.983354 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j99dq\" (UniqueName: \"kubernetes.io/projected/c0938401-5843-4035-877c-14c1be081213-kube-api-access-j99dq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.983556 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.983478 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.983731 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.983713 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.983792 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.983777 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:00.992639 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:00.992578 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j99dq\" (UniqueName: \"kubernetes.io/projected/c0938401-5843-4035-877c-14c1be081213-kube-api-access-j99dq\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:01.054527 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.054494 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:01.194581 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.194549 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss"] Jul 16 00:24:01.197869 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:24:01.197840 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0938401_5843_4035_877c_14c1be081213.slice/crio-f6eee0d71123d555c5a189dcbfe3d810b78dfd68512e2e5f4e9846a398d2faf3 WatchSource:0}: Error finding container f6eee0d71123d555c5a189dcbfe3d810b78dfd68512e2e5f4e9846a398d2faf3: Status 404 returned error can't find the container with id f6eee0d71123d555c5a189dcbfe3d810b78dfd68512e2e5f4e9846a398d2faf3 Jul 16 00:24:01.549881 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.549797 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6"] Jul 16 00:24:01.553359 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.553343 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.567176 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.566941 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6"] Jul 16 00:24:01.690743 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.690698 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.690743 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.690739 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.690999 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.690769 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjrcj\" (UniqueName: \"kubernetes.io/projected/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-kube-api-access-hjrcj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.791520 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.791468 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.791520 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.791517 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.792103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.791640 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjrcj\" (UniqueName: \"kubernetes.io/projected/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-kube-api-access-hjrcj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.792103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.791849 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.792103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.791897 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.800784 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.800730 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjrcj\" (UniqueName: \"kubernetes.io/projected/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-kube-api-access-hjrcj\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:01.869596 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:01.869554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:02.001378 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.001352 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6"] Jul 16 00:24:02.003682 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:24:02.003648 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbb4193d_e982_4ebe_ae41_45c04edbbb5e.slice/crio-c6181bdeb3e399e220131e32b0b1b9551001dd357bff9da369b9c225898745aa WatchSource:0}: Error finding container c6181bdeb3e399e220131e32b0b1b9551001dd357bff9da369b9c225898745aa: Status 404 returned error can't find the container with id c6181bdeb3e399e220131e32b0b1b9551001dd357bff9da369b9c225898745aa Jul 16 00:24:02.055688 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.055652 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" event={"ID":"bbb4193d-e982-4ebe-ae41-45c04edbbb5e","Type":"ContainerStarted","Data":"c6181bdeb3e399e220131e32b0b1b9551001dd357bff9da369b9c225898745aa"} Jul 16 00:24:02.057352 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.057323 2557 generic.go:356] "Generic (PLEG): container finished" podID="c0938401-5843-4035-877c-14c1be081213" containerID="d55f9fa00614ba19faf379060a37cf521768d8a1fb450c618de0f8c6be1ac525" exitCode=0 Jul 16 00:24:02.057467 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.057396 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" event={"ID":"c0938401-5843-4035-877c-14c1be081213","Type":"ContainerDied","Data":"d55f9fa00614ba19faf379060a37cf521768d8a1fb450c618de0f8c6be1ac525"} Jul 16 00:24:02.057467 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.057449 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" event={"ID":"c0938401-5843-4035-877c-14c1be081213","Type":"ContainerStarted","Data":"f6eee0d71123d555c5a189dcbfe3d810b78dfd68512e2e5f4e9846a398d2faf3"} Jul 16 00:24:02.057925 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.057911 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:24:02.134099 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.134061 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww"] Jul 16 00:24:02.137716 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.137693 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.146239 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.146214 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww"] Jul 16 00:24:02.296526 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.296481 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.296714 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.296554 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4hf7\" (UniqueName: \"kubernetes.io/projected/c0893b73-e213-4ade-aeff-c631fc181d00-kube-api-access-w4hf7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.296714 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.296600 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.398032 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.397940 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4hf7\" (UniqueName: \"kubernetes.io/projected/c0893b73-e213-4ade-aeff-c631fc181d00-kube-api-access-w4hf7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.398208 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.398044 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.398208 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.398107 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.398484 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.398465 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.398525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.398491 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.408047 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.408026 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4hf7\" (UniqueName: \"kubernetes.io/projected/c0893b73-e213-4ade-aeff-c631fc181d00-kube-api-access-w4hf7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.477664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.477625 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:02.545500 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.545468 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr"] Jul 16 00:24:02.549376 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.549358 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.562675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.562648 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr"] Jul 16 00:24:02.616083 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.616059 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww"] Jul 16 00:24:02.617940 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:24:02.617916 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0893b73_e213_4ade_aeff_c631fc181d00.slice/crio-6b8eeea7e2c9012114c6fac5498dc4ebcd99b6e575ce7ea478c47f20ace8bcd1 WatchSource:0}: Error finding container 6b8eeea7e2c9012114c6fac5498dc4ebcd99b6e575ce7ea478c47f20ace8bcd1: Status 404 returned error can't find the container with id 6b8eeea7e2c9012114c6fac5498dc4ebcd99b6e575ce7ea478c47f20ace8bcd1 Jul 16 00:24:02.700507 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.700456 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmrx\" (UniqueName: \"kubernetes.io/projected/245e3114-4a00-434c-b8ed-50547f9a40e7-kube-api-access-vqmrx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.700680 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.700655 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.700757 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.700732 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.802106 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.802066 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmrx\" (UniqueName: \"kubernetes.io/projected/245e3114-4a00-434c-b8ed-50547f9a40e7-kube-api-access-vqmrx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.802786 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.802152 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.802786 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.802188 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.802786 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.802543 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.802786 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.802550 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.811048 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.811017 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmrx\" (UniqueName: \"kubernetes.io/projected/245e3114-4a00-434c-b8ed-50547f9a40e7-kube-api-access-vqmrx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:02.861023 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:02.860988 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:03.020299 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.020269 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr"] Jul 16 00:24:03.037413 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:24:03.037374 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod245e3114_4a00_434c_b8ed_50547f9a40e7.slice/crio-5ed147c49d0a42f2ad7fd639e014d75566092f7687367a4cd3724a911459bf0f WatchSource:0}: Error finding container 5ed147c49d0a42f2ad7fd639e014d75566092f7687367a4cd3724a911459bf0f: Status 404 returned error can't find the container with id 5ed147c49d0a42f2ad7fd639e014d75566092f7687367a4cd3724a911459bf0f Jul 16 00:24:03.065573 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.065542 2557 generic.go:356] "Generic (PLEG): container finished" podID="c0938401-5843-4035-877c-14c1be081213" containerID="70688bdc55a2550d0643826f0dd184a378b72d1a3e911f0e3171b3c167b9cac0" exitCode=0 Jul 16 00:24:03.065741 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.065625 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" event={"ID":"c0938401-5843-4035-877c-14c1be081213","Type":"ContainerDied","Data":"70688bdc55a2550d0643826f0dd184a378b72d1a3e911f0e3171b3c167b9cac0"} Jul 16 00:24:03.067240 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.067221 2557 generic.go:356] "Generic (PLEG): container finished" podID="c0893b73-e213-4ade-aeff-c631fc181d00" containerID="9481fdc5507641f52caa8fada148460daaa4616286ed40bd4264ac5a901f2d32" exitCode=0 Jul 16 00:24:03.067322 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.067301 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" event={"ID":"c0893b73-e213-4ade-aeff-c631fc181d00","Type":"ContainerDied","Data":"9481fdc5507641f52caa8fada148460daaa4616286ed40bd4264ac5a901f2d32"} Jul 16 00:24:03.067379 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.067362 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" event={"ID":"c0893b73-e213-4ade-aeff-c631fc181d00","Type":"ContainerStarted","Data":"6b8eeea7e2c9012114c6fac5498dc4ebcd99b6e575ce7ea478c47f20ace8bcd1"} Jul 16 00:24:03.068624 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.068605 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" event={"ID":"245e3114-4a00-434c-b8ed-50547f9a40e7","Type":"ContainerStarted","Data":"5ed147c49d0a42f2ad7fd639e014d75566092f7687367a4cd3724a911459bf0f"} Jul 16 00:24:03.070240 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.070214 2557 generic.go:356] "Generic (PLEG): container finished" podID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerID="38cfdf1b876a2200c2b329774fb9257afa93505e55d2b82ca0b72c7b6fe3d750" exitCode=0 Jul 16 00:24:03.070324 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:03.070279 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" event={"ID":"bbb4193d-e982-4ebe-ae41-45c04edbbb5e","Type":"ContainerDied","Data":"38cfdf1b876a2200c2b329774fb9257afa93505e55d2b82ca0b72c7b6fe3d750"} Jul 16 00:24:04.077770 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.077740 2557 generic.go:356] "Generic (PLEG): container finished" podID="c0938401-5843-4035-877c-14c1be081213" containerID="5e1751922b4a604a202a66b9911cdf3e84eb4941be4228e1902668d165a915c8" exitCode=0 Jul 16 00:24:04.078218 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.077824 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" event={"ID":"c0938401-5843-4035-877c-14c1be081213","Type":"ContainerDied","Data":"5e1751922b4a604a202a66b9911cdf3e84eb4941be4228e1902668d165a915c8"} Jul 16 00:24:04.079688 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.079661 2557 generic.go:356] "Generic (PLEG): container finished" podID="c0893b73-e213-4ade-aeff-c631fc181d00" containerID="1f42a71253279fa44b419e6103ced4aedbbdd2e87ab39ef524c161c167d1bd5a" exitCode=0 Jul 16 00:24:04.079814 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.079735 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" event={"ID":"c0893b73-e213-4ade-aeff-c631fc181d00","Type":"ContainerDied","Data":"1f42a71253279fa44b419e6103ced4aedbbdd2e87ab39ef524c161c167d1bd5a"} Jul 16 00:24:04.081159 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.081135 2557 generic.go:356] "Generic (PLEG): container finished" podID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerID="f2f6c85c7c6b72bbb41945669ac2a8343b076ac16d64e7599de9211680357423" exitCode=0 Jul 16 00:24:04.081267 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.081162 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" event={"ID":"245e3114-4a00-434c-b8ed-50547f9a40e7","Type":"ContainerDied","Data":"f2f6c85c7c6b72bbb41945669ac2a8343b076ac16d64e7599de9211680357423"} Jul 16 00:24:04.083134 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.083116 2557 generic.go:356] "Generic (PLEG): container finished" podID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerID="6ef7d67b6ef6247e003b904d7560aa35ea1f9464cb867a64ff64eff226772f1e" exitCode=0 Jul 16 00:24:04.083215 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:04.083143 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" event={"ID":"bbb4193d-e982-4ebe-ae41-45c04edbbb5e","Type":"ContainerDied","Data":"6ef7d67b6ef6247e003b904d7560aa35ea1f9464cb867a64ff64eff226772f1e"} Jul 16 00:24:05.091084 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.091048 2557 generic.go:356] "Generic (PLEG): container finished" podID="c0893b73-e213-4ade-aeff-c631fc181d00" containerID="89a49f228eb7d492218a3c82e4667c46df3dc4aae3935938e0a97860a6715ec7" exitCode=0 Jul 16 00:24:05.091489 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.091125 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" event={"ID":"c0893b73-e213-4ade-aeff-c631fc181d00","Type":"ContainerDied","Data":"89a49f228eb7d492218a3c82e4667c46df3dc4aae3935938e0a97860a6715ec7"} Jul 16 00:24:05.093251 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.093222 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" event={"ID":"245e3114-4a00-434c-b8ed-50547f9a40e7","Type":"ContainerStarted","Data":"7128bf2f15f60267a914ce2a49d1c87a4020c64b9b9a28bcd61422fa2d4dca8f"} Jul 16 00:24:05.095757 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.095731 2557 generic.go:356] "Generic (PLEG): container finished" podID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerID="c85f14f102ce05523205c806a4d9d2dbf3f030560e5bb12548db911b722bab55" exitCode=0 Jul 16 00:24:05.095845 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.095785 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" event={"ID":"bbb4193d-e982-4ebe-ae41-45c04edbbb5e","Type":"ContainerDied","Data":"c85f14f102ce05523205c806a4d9d2dbf3f030560e5bb12548db911b722bab55"} Jul 16 00:24:05.241167 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.241141 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:05.425074 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.425042 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-bundle\") pod \"c0938401-5843-4035-877c-14c1be081213\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " Jul 16 00:24:05.425280 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.425096 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j99dq\" (UniqueName: \"kubernetes.io/projected/c0938401-5843-4035-877c-14c1be081213-kube-api-access-j99dq\") pod \"c0938401-5843-4035-877c-14c1be081213\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " Jul 16 00:24:05.425280 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.425128 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-util\") pod \"c0938401-5843-4035-877c-14c1be081213\" (UID: \"c0938401-5843-4035-877c-14c1be081213\") " Jul 16 00:24:05.425585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.425563 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-bundle" (OuterVolumeSpecName: "bundle") pod "c0938401-5843-4035-877c-14c1be081213" (UID: "c0938401-5843-4035-877c-14c1be081213"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:05.427557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.427529 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0938401-5843-4035-877c-14c1be081213-kube-api-access-j99dq" (OuterVolumeSpecName: "kube-api-access-j99dq") pod "c0938401-5843-4035-877c-14c1be081213" (UID: "c0938401-5843-4035-877c-14c1be081213"). InnerVolumeSpecName "kube-api-access-j99dq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:24:05.431245 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.431221 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-util" (OuterVolumeSpecName: "util") pod "c0938401-5843-4035-877c-14c1be081213" (UID: "c0938401-5843-4035-877c-14c1be081213"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:05.525900 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.525801 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-bundle\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:05.525900 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.525838 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j99dq\" (UniqueName: \"kubernetes.io/projected/c0938401-5843-4035-877c-14c1be081213-kube-api-access-j99dq\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:05.525900 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:05.525853 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0938401-5843-4035-877c-14c1be081213-util\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:06.103272 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.103242 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" Jul 16 00:24:06.103719 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.103247 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss" event={"ID":"c0938401-5843-4035-877c-14c1be081213","Type":"ContainerDied","Data":"f6eee0d71123d555c5a189dcbfe3d810b78dfd68512e2e5f4e9846a398d2faf3"} Jul 16 00:24:06.103719 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.103376 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f6eee0d71123d555c5a189dcbfe3d810b78dfd68512e2e5f4e9846a398d2faf3" Jul 16 00:24:06.105375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.105349 2557 generic.go:356] "Generic (PLEG): container finished" podID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerID="7128bf2f15f60267a914ce2a49d1c87a4020c64b9b9a28bcd61422fa2d4dca8f" exitCode=0 Jul 16 00:24:06.105375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.105371 2557 generic.go:356] "Generic (PLEG): container finished" podID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerID="ba6407deac3d3e044d471b7fcb37ed3b93fcb10988ae0cfb9a2a3739bfdf07ea" exitCode=0 Jul 16 00:24:06.105544 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.105432 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" event={"ID":"245e3114-4a00-434c-b8ed-50547f9a40e7","Type":"ContainerDied","Data":"7128bf2f15f60267a914ce2a49d1c87a4020c64b9b9a28bcd61422fa2d4dca8f"} Jul 16 00:24:06.105544 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.105487 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" event={"ID":"245e3114-4a00-434c-b8ed-50547f9a40e7","Type":"ContainerDied","Data":"ba6407deac3d3e044d471b7fcb37ed3b93fcb10988ae0cfb9a2a3739bfdf07ea"} Jul 16 00:24:06.155682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.155644 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:06.254051 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.254025 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:06.264235 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.264211 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:06.266472 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.266456 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:06.433576 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.433491 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-bundle\") pod \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " Jul 16 00:24:06.433576 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.433539 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4hf7\" (UniqueName: \"kubernetes.io/projected/c0893b73-e213-4ade-aeff-c631fc181d00-kube-api-access-w4hf7\") pod \"c0893b73-e213-4ade-aeff-c631fc181d00\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " Jul 16 00:24:06.433763 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.433590 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hjrcj\" (UniqueName: \"kubernetes.io/projected/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-kube-api-access-hjrcj\") pod \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " Jul 16 00:24:06.433763 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.433622 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-util\") pod \"c0893b73-e213-4ade-aeff-c631fc181d00\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " Jul 16 00:24:06.433763 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.433739 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-util\") pod \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\" (UID: \"bbb4193d-e982-4ebe-ae41-45c04edbbb5e\") " Jul 16 00:24:06.433902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.433805 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-bundle\") pod \"c0893b73-e213-4ade-aeff-c631fc181d00\" (UID: \"c0893b73-e213-4ade-aeff-c631fc181d00\") " Jul 16 00:24:06.434490 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.434459 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-bundle" (OuterVolumeSpecName: "bundle") pod "bbb4193d-e982-4ebe-ae41-45c04edbbb5e" (UID: "bbb4193d-e982-4ebe-ae41-45c04edbbb5e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:06.434674 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.434644 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-bundle" (OuterVolumeSpecName: "bundle") pod "c0893b73-e213-4ade-aeff-c631fc181d00" (UID: "c0893b73-e213-4ade-aeff-c631fc181d00"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:06.435860 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.435838 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0893b73-e213-4ade-aeff-c631fc181d00-kube-api-access-w4hf7" (OuterVolumeSpecName: "kube-api-access-w4hf7") pod "c0893b73-e213-4ade-aeff-c631fc181d00" (UID: "c0893b73-e213-4ade-aeff-c631fc181d00"). InnerVolumeSpecName "kube-api-access-w4hf7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:24:06.436018 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.435863 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-kube-api-access-hjrcj" (OuterVolumeSpecName: "kube-api-access-hjrcj") pod "bbb4193d-e982-4ebe-ae41-45c04edbbb5e" (UID: "bbb4193d-e982-4ebe-ae41-45c04edbbb5e"). InnerVolumeSpecName "kube-api-access-hjrcj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:24:06.439621 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.439598 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-util" (OuterVolumeSpecName: "util") pod "c0893b73-e213-4ade-aeff-c631fc181d00" (UID: "c0893b73-e213-4ade-aeff-c631fc181d00"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:06.442631 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.442603 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-util" (OuterVolumeSpecName: "util") pod "bbb4193d-e982-4ebe-ae41-45c04edbbb5e" (UID: "bbb4193d-e982-4ebe-ae41-45c04edbbb5e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:06.534528 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.534496 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-bundle\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:06.534528 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.534525 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4hf7\" (UniqueName: \"kubernetes.io/projected/c0893b73-e213-4ade-aeff-c631fc181d00-kube-api-access-w4hf7\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:06.534528 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.534536 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hjrcj\" (UniqueName: \"kubernetes.io/projected/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-kube-api-access-hjrcj\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:06.534769 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.534544 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-util\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:06.534769 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.534552 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbb4193d-e982-4ebe-ae41-45c04edbbb5e-util\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:06.534769 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:06.534561 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0893b73-e213-4ade-aeff-c631fc181d00-bundle\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:07.112018 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.111983 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" Jul 16 00:24:07.112477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.111981 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww" event={"ID":"c0893b73-e213-4ade-aeff-c631fc181d00","Type":"ContainerDied","Data":"6b8eeea7e2c9012114c6fac5498dc4ebcd99b6e575ce7ea478c47f20ace8bcd1"} Jul 16 00:24:07.112477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.112160 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6b8eeea7e2c9012114c6fac5498dc4ebcd99b6e575ce7ea478c47f20ace8bcd1" Jul 16 00:24:07.113978 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.113943 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" event={"ID":"bbb4193d-e982-4ebe-ae41-45c04edbbb5e","Type":"ContainerDied","Data":"c6181bdeb3e399e220131e32b0b1b9551001dd357bff9da369b9c225898745aa"} Jul 16 00:24:07.114081 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.113991 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6" Jul 16 00:24:07.114081 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.114003 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c6181bdeb3e399e220131e32b0b1b9551001dd357bff9da369b9c225898745aa" Jul 16 00:24:07.248420 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.248394 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:07.340924 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.340886 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vqmrx\" (UniqueName: \"kubernetes.io/projected/245e3114-4a00-434c-b8ed-50547f9a40e7-kube-api-access-vqmrx\") pod \"245e3114-4a00-434c-b8ed-50547f9a40e7\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " Jul 16 00:24:07.340924 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.340921 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-util\") pod \"245e3114-4a00-434c-b8ed-50547f9a40e7\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " Jul 16 00:24:07.341169 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.340980 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-bundle\") pod \"245e3114-4a00-434c-b8ed-50547f9a40e7\" (UID: \"245e3114-4a00-434c-b8ed-50547f9a40e7\") " Jul 16 00:24:07.341441 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.341415 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-bundle" (OuterVolumeSpecName: "bundle") pod "245e3114-4a00-434c-b8ed-50547f9a40e7" (UID: "245e3114-4a00-434c-b8ed-50547f9a40e7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:07.343037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.343015 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/245e3114-4a00-434c-b8ed-50547f9a40e7-kube-api-access-vqmrx" (OuterVolumeSpecName: "kube-api-access-vqmrx") pod "245e3114-4a00-434c-b8ed-50547f9a40e7" (UID: "245e3114-4a00-434c-b8ed-50547f9a40e7"). InnerVolumeSpecName "kube-api-access-vqmrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:24:07.346293 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.346270 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-util" (OuterVolumeSpecName: "util") pod "245e3114-4a00-434c-b8ed-50547f9a40e7" (UID: "245e3114-4a00-434c-b8ed-50547f9a40e7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:24:07.442219 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.442122 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vqmrx\" (UniqueName: \"kubernetes.io/projected/245e3114-4a00-434c-b8ed-50547f9a40e7-kube-api-access-vqmrx\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:07.442219 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.442156 2557 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-util\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:07.442219 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:07.442170 2557 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/245e3114-4a00-434c-b8ed-50547f9a40e7-bundle\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:24:08.121836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:08.121801 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" event={"ID":"245e3114-4a00-434c-b8ed-50547f9a40e7","Type":"ContainerDied","Data":"5ed147c49d0a42f2ad7fd639e014d75566092f7687367a4cd3724a911459bf0f"} Jul 16 00:24:08.121836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:08.121818 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr" Jul 16 00:24:08.122243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:08.121848 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5ed147c49d0a42f2ad7fd639e014d75566092f7687367a4cd3724a911459bf0f" Jul 16 00:24:14.455602 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:14.455566 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:15.016024 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:15.015994 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:16.079663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:16.079622 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:19.661650 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:19.661615 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:19.797742 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:19.797707 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:22.468027 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:22.467988 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:22.901423 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:22.901390 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:24.893672 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:24.893625 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:25.036266 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:25.036224 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:27.969354 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:27.969312 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:30.059297 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:30.059258 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:30.157983 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:30.157928 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:30.517756 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:30.517717 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:30.637344 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:30.637299 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:30.970446 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:30.970345 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:31.189973 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:31.189926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:31.310189 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:31.310153 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:34.064380 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:34.064333 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:34.164183 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:34.164144 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:37.749210 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:37.749086 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:38.088780 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:38.088661 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:38.228588 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:38.228556 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:38.353402 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:38.353303 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:41.723396 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:41.723361 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:41.851389 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:41.851354 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:49.259659 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:49.259616 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:49.414218 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:49.414179 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:50.121104 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:50.121067 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:50.382065 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:50.381958 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:52.619987 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:52.619928 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:52.752201 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:52.752160 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:58.052724 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:58.052674 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:24:58.351338 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:24:58.351242 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:01.872013 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:01.871953 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:02.050474 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:02.050437 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:27.267103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:27.267059 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:27.368783 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:27.368747 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:29.620667 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.620633 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2"] Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.620974 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0893b73-e213-4ade-aeff-c631fc181d00" containerName="util" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.620985 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0893b73-e213-4ade-aeff-c631fc181d00" containerName="util" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.620994 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0938401-5843-4035-877c-14c1be081213" containerName="extract" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621000 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0938401-5843-4035-877c-14c1be081213" containerName="extract" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621017 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0938401-5843-4035-877c-14c1be081213" containerName="pull" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621023 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0938401-5843-4035-877c-14c1be081213" containerName="pull" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621028 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0893b73-e213-4ade-aeff-c631fc181d00" containerName="extract" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621033 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0893b73-e213-4ade-aeff-c631fc181d00" containerName="extract" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621040 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0938401-5843-4035-877c-14c1be081213" containerName="util" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621044 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0938401-5843-4035-877c-14c1be081213" containerName="util" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621050 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerName="pull" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621054 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerName="pull" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621060 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerName="util" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621065 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerName="util" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621070 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerName="pull" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621074 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerName="pull" Jul 16 00:25:29.621072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621081 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerName="extract" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621086 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerName="extract" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621091 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerName="extract" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621096 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerName="extract" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621105 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerName="util" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621110 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerName="util" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621115 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0893b73-e213-4ade-aeff-c631fc181d00" containerName="pull" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621120 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0893b73-e213-4ade-aeff-c631fc181d00" containerName="pull" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621167 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bbb4193d-e982-4ebe-ae41-45c04edbbb5e" containerName="extract" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621174 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="245e3114-4a00-434c-b8ed-50547f9a40e7" containerName="extract" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621181 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0938401-5843-4035-877c-14c1be081213" containerName="extract" Jul 16 00:25:29.621549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.621189 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0893b73-e213-4ade-aeff-c631fc181d00" containerName="extract" Jul 16 00:25:29.624157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.624140 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.628384 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.628359 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lmv56\"" Jul 16 00:25:29.628914 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.628895 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 16 00:25:29.652744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.652706 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2"] Jul 16 00:25:29.685820 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.685776 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:29.757661 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757623 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.757840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757682 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.757840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757739 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.757840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757790 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190ec2b1-33ff-4db9-98d2-9e25495283c3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.757840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757812 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.757840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757838 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.758054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757857 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.758054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757888 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.758054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.757910 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj2v4\" (UniqueName: \"kubernetes.io/projected/190ec2b1-33ff-4db9-98d2-9e25495283c3-kube-api-access-gj2v4\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.858934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.858897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.858934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.858938 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gj2v4\" (UniqueName: \"kubernetes.io/projected/190ec2b1-33ff-4db9-98d2-9e25495283c3-kube-api-access-gj2v4\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859136 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859025 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859136 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859075 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859136 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859100 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859503 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859135 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190ec2b1-33ff-4db9-98d2-9e25495283c3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859503 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859166 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859503 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859187 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859503 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859208 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859796 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859576 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859796 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859659 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859796 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859666 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.859796 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859736 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.860077 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.859895 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/190ec2b1-33ff-4db9-98d2-9e25495283c3-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.861373 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.861346 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:29.861562 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.861546 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.861795 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.861779 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.873329 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.873270 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/190ec2b1-33ff-4db9-98d2-9e25495283c3-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.874100 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.874082 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj2v4\" (UniqueName: \"kubernetes.io/projected/190ec2b1-33ff-4db9-98d2-9e25495283c3-kube-api-access-gj2v4\") pod \"maas-default-gateway-openshift-default-56654dcf7-9nff2\" (UID: \"190ec2b1-33ff-4db9-98d2-9e25495283c3\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:29.934185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:29.934149 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:30.085194 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:25:30.085163 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod190ec2b1_33ff_4db9_98d2_9e25495283c3.slice/crio-c3662093357ad28fa17a0eefb133a05d793c0ff476581fdf3f8553968a449793 WatchSource:0}: Error finding container c3662093357ad28fa17a0eefb133a05d793c0ff476581fdf3f8553968a449793: Status 404 returned error can't find the container with id c3662093357ad28fa17a0eefb133a05d793c0ff476581fdf3f8553968a449793 Jul 16 00:25:30.087317 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.087289 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:25:30.087429 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.087361 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:25:30.087429 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.087394 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:25:30.087755 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.087735 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2"] Jul 16 00:25:30.549750 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.549716 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" event={"ID":"190ec2b1-33ff-4db9-98d2-9e25495283c3","Type":"ContainerStarted","Data":"0739f9acfd4dcd29103e3ef509da27c072fc000026585a3f5a62b98c72697739"} Jul 16 00:25:30.549932 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.549768 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" event={"ID":"190ec2b1-33ff-4db9-98d2-9e25495283c3","Type":"ContainerStarted","Data":"c3662093357ad28fa17a0eefb133a05d793c0ff476581fdf3f8553968a449793"} Jul 16 00:25:30.601894 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.601813 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" podStartSLOduration=1.601791898 podStartE2EDuration="1.601791898s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:30.597172871 +0000 UTC m=+766.665036158" watchObservedRunningTime="2026-07-16 00:25:30.601791898 +0000 UTC m=+766.669655187" Jul 16 00:25:30.934933 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:30.934840 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:31.941916 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:31.941882 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:31.960119 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:31.960085 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:32.138413 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.138368 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:32.417838 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.417798 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:32.560297 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.560261 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:32.561210 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.561190 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:25:32.902373 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.902339 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-qsgvz"] Jul 16 00:25:32.905865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.905849 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsgvz" Jul 16 00:25:32.909472 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.909448 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mdmzd\"" Jul 16 00:25:32.909780 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.909763 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 00:25:32.910064 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.910049 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 00:25:32.934495 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.934461 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsgvz"] Jul 16 00:25:32.959471 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.959435 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:32.988473 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:32.988448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4czk\" (UniqueName: \"kubernetes.io/projected/abbb6b6b-f4bc-41eb-bb32-6966a5184c35-kube-api-access-z4czk\") pod \"authorino-58cd955675-qsgvz\" (UID: \"abbb6b6b-f4bc-41eb-bb32-6966a5184c35\") " pod="kuadrant-system/authorino-58cd955675-qsgvz" Jul 16 00:25:33.069434 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:33.069393 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:33.089160 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:33.089134 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4czk\" (UniqueName: \"kubernetes.io/projected/abbb6b6b-f4bc-41eb-bb32-6966a5184c35-kube-api-access-z4czk\") pod \"authorino-58cd955675-qsgvz\" (UID: \"abbb6b6b-f4bc-41eb-bb32-6966a5184c35\") " pod="kuadrant-system/authorino-58cd955675-qsgvz" Jul 16 00:25:33.109614 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:33.109586 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4czk\" (UniqueName: \"kubernetes.io/projected/abbb6b6b-f4bc-41eb-bb32-6966a5184c35-kube-api-access-z4czk\") pod \"authorino-58cd955675-qsgvz\" (UID: \"abbb6b6b-f4bc-41eb-bb32-6966a5184c35\") " pod="kuadrant-system/authorino-58cd955675-qsgvz" Jul 16 00:25:33.215439 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:33.215354 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsgvz" Jul 16 00:25:33.356603 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:33.356563 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsgvz"] Jul 16 00:25:33.357702 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:25:33.357677 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabbb6b6b_f4bc_41eb_bb32_6966a5184c35.slice/crio-bc0c87b2ac1a55a5f5b98e1e92f017125f8a3827a6e7923cb5a9327725b3d3b7 WatchSource:0}: Error finding container bc0c87b2ac1a55a5f5b98e1e92f017125f8a3827a6e7923cb5a9327725b3d3b7: Status 404 returned error can't find the container with id bc0c87b2ac1a55a5f5b98e1e92f017125f8a3827a6e7923cb5a9327725b3d3b7 Jul 16 00:25:33.566070 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:33.566036 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsgvz" event={"ID":"abbb6b6b-f4bc-41eb-bb32-6966a5184c35","Type":"ContainerStarted","Data":"bc0c87b2ac1a55a5f5b98e1e92f017125f8a3827a6e7923cb5a9327725b3d3b7"} Jul 16 00:25:37.593248 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:37.593211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsgvz" event={"ID":"abbb6b6b-f4bc-41eb-bb32-6966a5184c35","Type":"ContainerStarted","Data":"36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145"} Jul 16 00:25:37.611053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:37.611001 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-qsgvz" podStartSLOduration=2.364794845 podStartE2EDuration="5.610984323s" totalImagesPullingTime="3.246189478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:25:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:25:37.609900158 +0000 UTC m=+773.677763446" watchObservedRunningTime="2026-07-16 00:25:37.610984323 +0000 UTC m=+773.678847606" Jul 16 00:25:38.200894 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:38.200857 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsgvz"] Jul 16 00:25:39.085697 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:39.085649 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:39.171631 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:39.171593 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:39.603459 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:39.603421 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-qsgvz" podUID="abbb6b6b-f4bc-41eb-bb32-6966a5184c35" containerName="authorino" containerID="cri-o://36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145" gracePeriod=30 Jul 16 00:25:39.853116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:39.853089 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsgvz" Jul 16 00:25:39.951608 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:39.951521 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z4czk\" (UniqueName: \"kubernetes.io/projected/abbb6b6b-f4bc-41eb-bb32-6966a5184c35-kube-api-access-z4czk\") pod \"abbb6b6b-f4bc-41eb-bb32-6966a5184c35\" (UID: \"abbb6b6b-f4bc-41eb-bb32-6966a5184c35\") " Jul 16 00:25:39.953444 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:39.953422 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abbb6b6b-f4bc-41eb-bb32-6966a5184c35-kube-api-access-z4czk" (OuterVolumeSpecName: "kube-api-access-z4czk") pod "abbb6b6b-f4bc-41eb-bb32-6966a5184c35" (UID: "abbb6b6b-f4bc-41eb-bb32-6966a5184c35"). InnerVolumeSpecName "kube-api-access-z4czk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:25:40.053134 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.053100 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z4czk\" (UniqueName: \"kubernetes.io/projected/abbb6b6b-f4bc-41eb-bb32-6966a5184c35-kube-api-access-z4czk\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:25:40.609534 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.609500 2557 generic.go:356] "Generic (PLEG): container finished" podID="abbb6b6b-f4bc-41eb-bb32-6966a5184c35" containerID="36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145" exitCode=0 Jul 16 00:25:40.609534 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.609538 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-qsgvz" Jul 16 00:25:40.610105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.609594 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsgvz" event={"ID":"abbb6b6b-f4bc-41eb-bb32-6966a5184c35","Type":"ContainerDied","Data":"36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145"} Jul 16 00:25:40.610105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.609653 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-qsgvz" event={"ID":"abbb6b6b-f4bc-41eb-bb32-6966a5184c35","Type":"ContainerDied","Data":"bc0c87b2ac1a55a5f5b98e1e92f017125f8a3827a6e7923cb5a9327725b3d3b7"} Jul 16 00:25:40.610105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.609681 2557 scope.go:117] "RemoveContainer" containerID="36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145" Jul 16 00:25:40.618259 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.618241 2557 scope.go:117] "RemoveContainer" containerID="36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145" Jul 16 00:25:40.618532 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:25:40.618516 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145\": container with ID starting with 36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145 not found: ID does not exist" containerID="36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145" Jul 16 00:25:40.618583 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.618541 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145"} err="failed to get container status \"36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145\": rpc error: code = NotFound desc = could not find container \"36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145\": container with ID starting with 36e8435e24ca078e4393b146e5e4fb7268f4aa905b3a9d7c32e9779dac3b8145 not found: ID does not exist" Jul 16 00:25:40.658316 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.658224 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsgvz"] Jul 16 00:25:40.662584 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:40.662557 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-qsgvz"] Jul 16 00:25:42.381882 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:42.381847 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abbb6b6b-f4bc-41eb-bb32-6966a5184c35" path="/var/lib/kubelet/pods/abbb6b6b-f4bc-41eb-bb32-6966a5184c35/volumes" Jul 16 00:25:48.222435 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:48.222393 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:53.210397 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:53.210359 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:53.538349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:53.538311 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:25:53.816859 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:25:53.816769 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:05.650803 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.650759 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:05.922545 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.922436 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwshz"] Jul 16 00:26:05.922836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.922820 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abbb6b6b-f4bc-41eb-bb32-6966a5184c35" containerName="authorino" Jul 16 00:26:05.922883 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.922838 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="abbb6b6b-f4bc-41eb-bb32-6966a5184c35" containerName="authorino" Jul 16 00:26:05.922920 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.922904 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="abbb6b6b-f4bc-41eb-bb32-6966a5184c35" containerName="authorino" Jul 16 00:26:05.927087 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.927065 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwshz" Jul 16 00:26:05.930524 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.930500 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-mdmzd\"" Jul 16 00:26:05.931683 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.931662 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 16 00:26:05.931783 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.931688 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 16 00:26:05.948356 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.948322 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwshz"] Jul 16 00:26:05.963381 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:05.963349 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjb55\" (UniqueName: \"kubernetes.io/projected/c9cf12c5-70dc-4ef0-ac04-7e2138d97507-kube-api-access-sjb55\") pod \"authorino-5d4b67c446-bwshz\" (UID: \"c9cf12c5-70dc-4ef0-ac04-7e2138d97507\") " pod="kuadrant-system/authorino-5d4b67c446-bwshz" Jul 16 00:26:06.063862 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.063822 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sjb55\" (UniqueName: \"kubernetes.io/projected/c9cf12c5-70dc-4ef0-ac04-7e2138d97507-kube-api-access-sjb55\") pod \"authorino-5d4b67c446-bwshz\" (UID: \"c9cf12c5-70dc-4ef0-ac04-7e2138d97507\") " pod="kuadrant-system/authorino-5d4b67c446-bwshz" Jul 16 00:26:06.079179 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.079151 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjb55\" (UniqueName: \"kubernetes.io/projected/c9cf12c5-70dc-4ef0-ac04-7e2138d97507-kube-api-access-sjb55\") pod \"authorino-5d4b67c446-bwshz\" (UID: \"c9cf12c5-70dc-4ef0-ac04-7e2138d97507\") " pod="kuadrant-system/authorino-5d4b67c446-bwshz" Jul 16 00:26:06.150996 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.150946 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwshz"] Jul 16 00:26:06.151223 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.151211 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwshz" Jul 16 00:26:06.311202 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.311179 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwshz"] Jul 16 00:26:06.313459 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:26:06.313420 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc9cf12c5_70dc_4ef0_ac04_7e2138d97507.slice/crio-6e17634acc0423240b97927a237c2cc4ee91949a368f07879e36be3b94f65b83 WatchSource:0}: Error finding container 6e17634acc0423240b97927a237c2cc4ee91949a368f07879e36be3b94f65b83: Status 404 returned error can't find the container with id 6e17634acc0423240b97927a237c2cc4ee91949a368f07879e36be3b94f65b83 Jul 16 00:26:06.365743 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.365709 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:06.750096 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.750063 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bwshz" event={"ID":"c9cf12c5-70dc-4ef0-ac04-7e2138d97507","Type":"ContainerStarted","Data":"6e17634acc0423240b97927a237c2cc4ee91949a368f07879e36be3b94f65b83"} Jul 16 00:26:06.879638 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.879601 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574b56fd47-8rrdp"] Jul 16 00:26:06.895888 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.895857 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:06.896921 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.896897 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574b56fd47-8rrdp"] Jul 16 00:26:06.898838 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.898818 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 16 00:26:06.970375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.970338 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jdjlr\" (UniqueName: \"kubernetes.io/projected/41f59c96-050a-4ad6-8382-81bd288b544e-kube-api-access-jdjlr\") pod \"authorino-574b56fd47-8rrdp\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:06.970375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:06.970376 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41f59c96-050a-4ad6-8382-81bd288b544e-tls-cert\") pod \"authorino-574b56fd47-8rrdp\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:07.071685 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.071652 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jdjlr\" (UniqueName: \"kubernetes.io/projected/41f59c96-050a-4ad6-8382-81bd288b544e-kube-api-access-jdjlr\") pod \"authorino-574b56fd47-8rrdp\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:07.071875 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.071694 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41f59c96-050a-4ad6-8382-81bd288b544e-tls-cert\") pod \"authorino-574b56fd47-8rrdp\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:07.074131 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.074107 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41f59c96-050a-4ad6-8382-81bd288b544e-tls-cert\") pod \"authorino-574b56fd47-8rrdp\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:07.081766 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.081739 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jdjlr\" (UniqueName: \"kubernetes.io/projected/41f59c96-050a-4ad6-8382-81bd288b544e-kube-api-access-jdjlr\") pod \"authorino-574b56fd47-8rrdp\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:07.205616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.205578 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:26:07.358043 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.358010 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574b56fd47-8rrdp"] Jul 16 00:26:07.757459 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.757421 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574b56fd47-8rrdp" event={"ID":"41f59c96-050a-4ad6-8382-81bd288b544e","Type":"ContainerStarted","Data":"e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a"} Jul 16 00:26:07.757896 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.757469 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574b56fd47-8rrdp" event={"ID":"41f59c96-050a-4ad6-8382-81bd288b544e","Type":"ContainerStarted","Data":"2aedf828683664c0735b260ce57dfb0b0af509f0392f0878fa50462933649fb2"} Jul 16 00:26:07.759239 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.759211 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bwshz" event={"ID":"c9cf12c5-70dc-4ef0-ac04-7e2138d97507","Type":"ContainerStarted","Data":"62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed"} Jul 16 00:26:07.759370 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.759275 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-bwshz" podUID="c9cf12c5-70dc-4ef0-ac04-7e2138d97507" containerName="authorino" containerID="cri-o://62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed" gracePeriod=30 Jul 16 00:26:07.783956 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.783902 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574b56fd47-8rrdp" podStartSLOduration=1.502502131 podStartE2EDuration="1.783881477s" totalImagesPullingTime="281.379346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:07.781918845 +0000 UTC m=+803.849782154" watchObservedRunningTime="2026-07-16 00:26:07.783881477 +0000 UTC m=+803.851744766" Jul 16 00:26:07.811274 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.811221 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-bwshz" podStartSLOduration=2.13716714 podStartE2EDuration="2.811203596s" totalImagesPullingTime="674.036456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:26:07.808694697 +0000 UTC m=+803.876558009" watchObservedRunningTime="2026-07-16 00:26:07.811203596 +0000 UTC m=+803.879066884" Jul 16 00:26:07.999585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:07.999562 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwshz" Jul 16 00:26:08.081065 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.081034 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sjb55\" (UniqueName: \"kubernetes.io/projected/c9cf12c5-70dc-4ef0-ac04-7e2138d97507-kube-api-access-sjb55\") pod \"c9cf12c5-70dc-4ef0-ac04-7e2138d97507\" (UID: \"c9cf12c5-70dc-4ef0-ac04-7e2138d97507\") " Jul 16 00:26:08.083061 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.083028 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c9cf12c5-70dc-4ef0-ac04-7e2138d97507-kube-api-access-sjb55" (OuterVolumeSpecName: "kube-api-access-sjb55") pod "c9cf12c5-70dc-4ef0-ac04-7e2138d97507" (UID: "c9cf12c5-70dc-4ef0-ac04-7e2138d97507"). InnerVolumeSpecName "kube-api-access-sjb55". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:26:08.181815 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.181727 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sjb55\" (UniqueName: \"kubernetes.io/projected/c9cf12c5-70dc-4ef0-ac04-7e2138d97507-kube-api-access-sjb55\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:26:08.765406 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.765371 2557 generic.go:356] "Generic (PLEG): container finished" podID="c9cf12c5-70dc-4ef0-ac04-7e2138d97507" containerID="62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed" exitCode=0 Jul 16 00:26:08.765406 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.765410 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-bwshz" Jul 16 00:26:08.765936 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.765452 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bwshz" event={"ID":"c9cf12c5-70dc-4ef0-ac04-7e2138d97507","Type":"ContainerDied","Data":"62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed"} Jul 16 00:26:08.765936 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.765497 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-bwshz" event={"ID":"c9cf12c5-70dc-4ef0-ac04-7e2138d97507","Type":"ContainerDied","Data":"6e17634acc0423240b97927a237c2cc4ee91949a368f07879e36be3b94f65b83"} Jul 16 00:26:08.765936 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.765519 2557 scope.go:117] "RemoveContainer" containerID="62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed" Jul 16 00:26:08.774296 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.774277 2557 scope.go:117] "RemoveContainer" containerID="62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed" Jul 16 00:26:08.774604 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:26:08.774584 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed\": container with ID starting with 62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed not found: ID does not exist" containerID="62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed" Jul 16 00:26:08.774650 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.774614 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed"} err="failed to get container status \"62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed\": rpc error: code = NotFound desc = could not find container \"62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed\": container with ID starting with 62e9034b4d908e2392aa620029166e6895995cea7e3f01d3dffafb0e3eed64ed not found: ID does not exist" Jul 16 00:26:08.794744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.794713 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwshz"] Jul 16 00:26:08.800276 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:08.800252 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-bwshz"] Jul 16 00:26:10.382683 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:10.382644 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c9cf12c5-70dc-4ef0-ac04-7e2138d97507" path="/var/lib/kubelet/pods/c9cf12c5-70dc-4ef0-ac04-7e2138d97507/volumes" Jul 16 00:26:12.828329 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:12.828265 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:12.988760 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:12.988723 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:13.135108 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:13.135019 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:13.388611 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:13.388518 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:16.372339 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:16.372308 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:16.508066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:16.508017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:47.518284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:47.518242 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:47.700951 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:47.700919 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:48.104430 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:48.104392 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:48.661394 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:48.661360 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:49.300332 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:49.300293 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:49.421846 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:49.421814 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:57.024512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:57.024476 2557 generic.go:356] "Generic (PLEG): container finished" podID="190ec2b1-33ff-4db9-98d2-9e25495283c3" containerID="0739f9acfd4dcd29103e3ef509da27c072fc000026585a3f5a62b98c72697739" exitCode=0 Jul 16 00:26:57.024912 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:57.024553 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" event={"ID":"190ec2b1-33ff-4db9-98d2-9e25495283c3","Type":"ContainerDied","Data":"0739f9acfd4dcd29103e3ef509da27c072fc000026585a3f5a62b98c72697739"} Jul 16 00:26:57.024997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:57.024954 2557 scope.go:117] "RemoveContainer" containerID="0739f9acfd4dcd29103e3ef509da27c072fc000026585a3f5a62b98c72697739" Jul 16 00:26:57.025917 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:57.025893 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:26:57.025988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:57.025975 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:26:57.026037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:57.026010 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:26:58.032020 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:58.031915 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" event={"ID":"190ec2b1-33ff-4db9-98d2-9e25495283c3","Type":"ContainerStarted","Data":"fa4e0fcbb67166fdd008f3876efa27663a4c070709377f7da3d28a3d3be9683e"} Jul 16 00:26:58.935034 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:58.934995 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:26:58.936222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:58.936196 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9nff2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 16 00:26:58.936338 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:58.936248 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" podUID="190ec2b1-33ff-4db9-98d2-9e25495283c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 16 00:26:59.590709 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:59.590636 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:59.780689 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:59.780641 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:26:59.935409 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:59.935316 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9nff2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 16 00:26:59.935409 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:26:59.935373 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" podUID="190ec2b1-33ff-4db9-98d2-9e25495283c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 16 00:27:00.935557 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:00.935515 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9nff2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 16 00:27:00.936077 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:00.935578 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" podUID="190ec2b1-33ff-4db9-98d2-9e25495283c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 16 00:27:01.935198 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:01.935157 2557 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-9nff2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" start-of-body= Jul 16 00:27:01.935406 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:01.935217 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" podUID="190ec2b1-33ff-4db9-98d2-9e25495283c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.39:15021/healthz/ready\": dial tcp 10.132.0.39:15021: connect: connection refused" Jul 16 00:27:02.560853 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:02.560820 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:27:02.939306 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:02.939225 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:27:03.063675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:03.063651 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-9nff2" Jul 16 00:27:06.496419 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:06.496384 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:27:19.707519 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:19.707474 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:27:31.533806 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.533766 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl"] Jul 16 00:27:31.534351 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.534326 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c9cf12c5-70dc-4ef0-ac04-7e2138d97507" containerName="authorino" Jul 16 00:27:31.534536 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.534513 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="c9cf12c5-70dc-4ef0-ac04-7e2138d97507" containerName="authorino" Jul 16 00:27:31.534697 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.534683 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="c9cf12c5-70dc-4ef0-ac04-7e2138d97507" containerName="authorino" Jul 16 00:27:31.538333 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.538312 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.543093 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.543076 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 16 00:27:31.543196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.543092 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 16 00:27:31.543196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.543113 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 16 00:27:31.543196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.543114 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-p88nw\"" Jul 16 00:27:31.549585 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.549553 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl"] Jul 16 00:27:31.585565 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.585535 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:27:31.607641 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.607608 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67w86\" (UniqueName: \"kubernetes.io/projected/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-kube-api-access-67w86\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.607752 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.607671 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.607752 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.607697 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.607752 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.607719 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.607752 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.607735 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.607957 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.607846 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.708977 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.708940 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709151 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709004 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709151 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709061 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709151 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709131 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67w86\" (UniqueName: \"kubernetes.io/projected/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-kube-api-access-67w86\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709197 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709242 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709392 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709478 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709436 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.709534 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.709475 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.711421 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.711399 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.711675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.711658 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.717941 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.717919 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67w86\" (UniqueName: \"kubernetes.io/projected/e219c125-22b3-4f5c-8b8f-92b8cfbd4743-kube-api-access-67w86\") pod \"e2e-trlp-test-simulated-kserve-598466548d-nkspl\" (UID: \"e219c125-22b3-4f5c-8b8f-92b8cfbd4743\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:31.868229 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:31.868137 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:32.012863 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:32.012839 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl"] Jul 16 00:27:32.015208 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:27:32.015182 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode219c125_22b3_4f5c_8b8f_92b8cfbd4743.slice/crio-c98cb9d4ab3651a060f4c9d181cfcf81988cca20c8b432bdffe8151cc95f5795 WatchSource:0}: Error finding container c98cb9d4ab3651a060f4c9d181cfcf81988cca20c8b432bdffe8151cc95f5795: Status 404 returned error can't find the container with id c98cb9d4ab3651a060f4c9d181cfcf81988cca20c8b432bdffe8151cc95f5795 Jul 16 00:27:32.214696 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:32.214615 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" event={"ID":"e219c125-22b3-4f5c-8b8f-92b8cfbd4743","Type":"ContainerStarted","Data":"c98cb9d4ab3651a060f4c9d181cfcf81988cca20c8b432bdffe8151cc95f5795"} Jul 16 00:27:33.222043 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:33.222003 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" event={"ID":"e219c125-22b3-4f5c-8b8f-92b8cfbd4743","Type":"ContainerStarted","Data":"202fb886d80cbd0746a2b37a13bc9859d5d7bd26b5f75f1b8f73b0452c23a4f2"} Jul 16 00:27:33.242843 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:33.242773 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" podStartSLOduration=1.232104191 podStartE2EDuration="2.242751572s" totalImagesPullingTime="1.010647381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:27:33.241727228 +0000 UTC m=+889.309590542" watchObservedRunningTime="2026-07-16 00:27:33.242751572 +0000 UTC m=+889.310614862" Jul 16 00:27:41.868693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:41.868605 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:41.868693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:41.868684 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:41.881085 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:41.881062 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:42.279678 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:42.279653 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-nkspl" Jul 16 00:27:44.381092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:44.381065 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:27:44.383438 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:44.383416 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:27:49.470370 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:49.470319 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:27:53.245791 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:27:53.245754 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:28:02.573345 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:28:02.573292 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:28:10.723824 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:28:10.723786 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:28:10.825158 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:28:10.825115 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:28:14.470370 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:28:14.470332 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:28:25.033335 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:28:25.033294 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:28:25.089400 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:28:25.089369 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:28:45.395600 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:28:45.395564 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:29:00.509144 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.509105 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-d9cb9f5fd-5rnvc"] Jul 16 00:29:00.512637 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.512615 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.521438 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.521408 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9cb9f5fd-5rnvc"] Jul 16 00:29:00.553052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.553024 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dxqs\" (UniqueName: \"kubernetes.io/projected/68b686de-81cc-4ef8-a7bf-74440dcc7089-kube-api-access-9dxqs\") pod \"authorino-d9cb9f5fd-5rnvc\" (UID: \"68b686de-81cc-4ef8-a7bf-74440dcc7089\") " pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.553162 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.553059 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/68b686de-81cc-4ef8-a7bf-74440dcc7089-tls-cert\") pod \"authorino-d9cb9f5fd-5rnvc\" (UID: \"68b686de-81cc-4ef8-a7bf-74440dcc7089\") " pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.654348 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.654320 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dxqs\" (UniqueName: \"kubernetes.io/projected/68b686de-81cc-4ef8-a7bf-74440dcc7089-kube-api-access-9dxqs\") pod \"authorino-d9cb9f5fd-5rnvc\" (UID: \"68b686de-81cc-4ef8-a7bf-74440dcc7089\") " pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.654348 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.654348 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/68b686de-81cc-4ef8-a7bf-74440dcc7089-tls-cert\") pod \"authorino-d9cb9f5fd-5rnvc\" (UID: \"68b686de-81cc-4ef8-a7bf-74440dcc7089\") " pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.656673 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.656652 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/68b686de-81cc-4ef8-a7bf-74440dcc7089-tls-cert\") pod \"authorino-d9cb9f5fd-5rnvc\" (UID: \"68b686de-81cc-4ef8-a7bf-74440dcc7089\") " pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.663799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.663775 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dxqs\" (UniqueName: \"kubernetes.io/projected/68b686de-81cc-4ef8-a7bf-74440dcc7089-kube-api-access-9dxqs\") pod \"authorino-d9cb9f5fd-5rnvc\" (UID: \"68b686de-81cc-4ef8-a7bf-74440dcc7089\") " pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.822091 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.822008 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" Jul 16 00:29:00.860257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.860225 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:29:00.962531 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.962464 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-d9cb9f5fd-5rnvc"] Jul 16 00:29:00.964920 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:00.964871 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:29:00.965223 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:29:00.965200 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68b686de_81cc_4ef8_a7bf_74440dcc7089.slice/crio-0009b1d8e89abde78802b875930369c02b5b0ed983310e671bc3905efd4638cd WatchSource:0}: Error finding container 0009b1d8e89abde78802b875930369c02b5b0ed983310e671bc3905efd4638cd: Status 404 returned error can't find the container with id 0009b1d8e89abde78802b875930369c02b5b0ed983310e671bc3905efd4638cd Jul 16 00:29:01.673486 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:01.673397 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" event={"ID":"68b686de-81cc-4ef8-a7bf-74440dcc7089","Type":"ContainerStarted","Data":"7ba9c69fa51596cb0da9be67344d9a7e1bc900a16c9983fd142dbf5ac68ec040"} Jul 16 00:29:01.673486 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:01.673448 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" event={"ID":"68b686de-81cc-4ef8-a7bf-74440dcc7089","Type":"ContainerStarted","Data":"0009b1d8e89abde78802b875930369c02b5b0ed983310e671bc3905efd4638cd"} Jul 16 00:29:01.755452 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:01.755378 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-d9cb9f5fd-5rnvc" podStartSLOduration=1.345587546 podStartE2EDuration="1.755353142s" totalImagesPullingTime="409.765596ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:29:01.703631386 +0000 UTC m=+977.771494692" watchObservedRunningTime="2026-07-16 00:29:01.755353142 +0000 UTC m=+977.823216434" Jul 16 00:29:01.758323 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:01.758292 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-574b56fd47-8rrdp"] Jul 16 00:29:01.758726 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:01.758690 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-574b56fd47-8rrdp" podUID="41f59c96-050a-4ad6-8382-81bd288b544e" containerName="authorino" containerID="cri-o://e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a" gracePeriod=30 Jul 16 00:29:02.018900 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.018869 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:29:02.066078 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.066041 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41f59c96-050a-4ad6-8382-81bd288b544e-tls-cert\") pod \"41f59c96-050a-4ad6-8382-81bd288b544e\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " Jul 16 00:29:02.066275 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.066164 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jdjlr\" (UniqueName: \"kubernetes.io/projected/41f59c96-050a-4ad6-8382-81bd288b544e-kube-api-access-jdjlr\") pod \"41f59c96-050a-4ad6-8382-81bd288b544e\" (UID: \"41f59c96-050a-4ad6-8382-81bd288b544e\") " Jul 16 00:29:02.068196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.068166 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41f59c96-050a-4ad6-8382-81bd288b544e-kube-api-access-jdjlr" (OuterVolumeSpecName: "kube-api-access-jdjlr") pod "41f59c96-050a-4ad6-8382-81bd288b544e" (UID: "41f59c96-050a-4ad6-8382-81bd288b544e"). InnerVolumeSpecName "kube-api-access-jdjlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:29:02.076669 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.076633 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/41f59c96-050a-4ad6-8382-81bd288b544e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "41f59c96-050a-4ad6-8382-81bd288b544e" (UID: "41f59c96-050a-4ad6-8382-81bd288b544e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 16 00:29:02.117987 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.117926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:29:02.167567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.167528 2557 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/41f59c96-050a-4ad6-8382-81bd288b544e-tls-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:29:02.167567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.167561 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jdjlr\" (UniqueName: \"kubernetes.io/projected/41f59c96-050a-4ad6-8382-81bd288b544e-kube-api-access-jdjlr\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:29:02.270369 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.270243 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:29:02.685116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.683730 2557 generic.go:356] "Generic (PLEG): container finished" podID="41f59c96-050a-4ad6-8382-81bd288b544e" containerID="e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a" exitCode=0 Jul 16 00:29:02.685116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.684360 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574b56fd47-8rrdp" Jul 16 00:29:02.685116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.684723 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574b56fd47-8rrdp" event={"ID":"41f59c96-050a-4ad6-8382-81bd288b544e","Type":"ContainerDied","Data":"e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a"} Jul 16 00:29:02.685116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.684758 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574b56fd47-8rrdp" event={"ID":"41f59c96-050a-4ad6-8382-81bd288b544e","Type":"ContainerDied","Data":"2aedf828683664c0735b260ce57dfb0b0af509f0392f0878fa50462933649fb2"} Jul 16 00:29:02.685116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.684778 2557 scope.go:117] "RemoveContainer" containerID="e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a" Jul 16 00:29:02.705306 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.705285 2557 scope.go:117] "RemoveContainer" containerID="e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a" Jul 16 00:29:02.705686 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:29:02.705661 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a\": container with ID starting with e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a not found: ID does not exist" containerID="e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a" Jul 16 00:29:02.705792 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.705690 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a"} err="failed to get container status \"e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a\": rpc error: code = NotFound desc = could not find container \"e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a\": container with ID starting with e6b1e465675df361d09883ac5c8c5e13a670d985031b553abe061374b088541a not found: ID does not exist" Jul 16 00:29:02.730766 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.730732 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-574b56fd47-8rrdp"] Jul 16 00:29:02.736583 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:02.736554 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-574b56fd47-8rrdp"] Jul 16 00:29:04.382521 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:29:04.382490 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41f59c96-050a-4ad6-8382-81bd288b544e" path="/var/lib/kubelet/pods/41f59c96-050a-4ad6-8382-81bd288b544e/volumes" Jul 16 00:30:00.142070 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.142039 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf"] Jul 16 00:30:00.142537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.142420 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41f59c96-050a-4ad6-8382-81bd288b544e" containerName="authorino" Jul 16 00:30:00.142537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.142433 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="41f59c96-050a-4ad6-8382-81bd288b544e" containerName="authorino" Jul 16 00:30:00.142537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.142513 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="41f59c96-050a-4ad6-8382-81bd288b544e" containerName="authorino" Jul 16 00:30:00.146722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.146706 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" Jul 16 00:30:00.149289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.149268 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qks69\"" Jul 16 00:30:00.153022 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.152997 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf"] Jul 16 00:30:00.157363 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.157344 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" Jul 16 00:30:00.295037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.295014 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf"] Jul 16 00:30:00.296688 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:30:00.296662 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a74346_4ad4_4cbb_94fa_63d925e55d00.slice/crio-4fc9bb8cee3e4f91426cadbfe7534e9f0522d9a0e90e4dfcd902de22c57c96b9 WatchSource:0}: Error finding container 4fc9bb8cee3e4f91426cadbfe7534e9f0522d9a0e90e4dfcd902de22c57c96b9: Status 404 returned error can't find the container with id 4fc9bb8cee3e4f91426cadbfe7534e9f0522d9a0e90e4dfcd902de22c57c96b9 Jul 16 00:30:00.298574 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:00.298559 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:30:01.002588 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:01.002550 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" event={"ID":"60a74346-4ad4-4cbb-94fa-63d925e55d00","Type":"ContainerStarted","Data":"4fc9bb8cee3e4f91426cadbfe7534e9f0522d9a0e90e4dfcd902de22c57c96b9"} Jul 16 00:30:03.017187 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:03.017147 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" event={"ID":"60a74346-4ad4-4cbb-94fa-63d925e55d00","Type":"ContainerStarted","Data":"7aeea7e7b226837f8e17ebbab9412b5c8d49dc759dc012c4eac97327a76f566f"} Jul 16 00:30:03.039882 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:03.039808 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" podStartSLOduration=0.767472778 podStartE2EDuration="3.039787672s" totalImagesPullingTime="2.272314894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:30:03.036746306 +0000 UTC m=+1039.104609595" watchObservedRunningTime="2026-07-16 00:30:03.039787672 +0000 UTC m=+1039.107650963" Jul 16 00:30:04.028870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:04.028835 2557 generic.go:356] "Generic (PLEG): container finished" podID="60a74346-4ad4-4cbb-94fa-63d925e55d00" containerID="7aeea7e7b226837f8e17ebbab9412b5c8d49dc759dc012c4eac97327a76f566f" exitCode=0 Jul 16 00:30:04.029279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:04.028922 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" event={"ID":"60a74346-4ad4-4cbb-94fa-63d925e55d00","Type":"ContainerDied","Data":"7aeea7e7b226837f8e17ebbab9412b5c8d49dc759dc012c4eac97327a76f566f"} Jul 16 00:30:05.159980 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:05.159941 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" Jul 16 00:30:06.040996 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:06.040972 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" Jul 16 00:30:06.041245 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:06.040998 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736030-s8lsf" event={"ID":"60a74346-4ad4-4cbb-94fa-63d925e55d00","Type":"ContainerDied","Data":"4fc9bb8cee3e4f91426cadbfe7534e9f0522d9a0e90e4dfcd902de22c57c96b9"} Jul 16 00:30:06.041245 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:06.041044 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4fc9bb8cee3e4f91426cadbfe7534e9f0522d9a0e90e4dfcd902de22c57c96b9" Jul 16 00:30:13.345366 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:13.345326 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:30:15.197927 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:15.197884 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:30:55.951076 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:55.950983 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:30:56.082639 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:56.082603 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:30:56.255847 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:30:56.255810 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:04.012266 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:04.012228 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:04.244744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:04.244705 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:04.407119 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:04.407018 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:04.624726 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:04.624665 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:11.200452 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:11.200420 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:11.316458 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:11.316422 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:17.386583 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:17.386550 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:31:17.483522 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:31:17.483492 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:32:31.251673 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:32:31.251581 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:32:44.418124 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:32:44.418098 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:32:44.422389 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:32:44.422369 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:34:45.112877 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:34:45.112840 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:34:46.306654 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:34:46.306625 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:35:22.482146 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:35:22.482068 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:35:38.606210 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:35:38.606171 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:37:44.453646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:37:44.453584 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:37:44.461516 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:37:44.461493 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:41:47.954945 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:41:47.954909 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:41:50.355974 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:41:50.355880 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:41:52.089204 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:41:52.089170 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:08.363499 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:08.363465 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:15.834215 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:15.834172 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:24.076279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:24.076242 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:29.229454 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:29.229422 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:32.360461 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:32.360405 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:32.564033 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:32.563997 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:32.910383 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:32.910352 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:39.999935 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:39.999845 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:40.146750 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.146715 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:40.260024 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.259934 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp"] Jul 16 00:42:40.260367 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.260354 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60a74346-4ad4-4cbb-94fa-63d925e55d00" containerName="cleanup" Jul 16 00:42:40.260406 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.260369 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="60a74346-4ad4-4cbb-94fa-63d925e55d00" containerName="cleanup" Jul 16 00:42:40.260451 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.260442 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="60a74346-4ad4-4cbb-94fa-63d925e55d00" containerName="cleanup" Jul 16 00:42:40.263525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.263509 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.266928 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.266903 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-b9cb77e6-openshift-default-dockercfg-47fqn\"" Jul 16 00:42:40.370376 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.370345 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp"] Jul 16 00:42:40.410457 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.410426 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:40.421646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421610 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-podinfo\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.421646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421647 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-data\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.421902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421674 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b461e696-81b7-43b9-88ef-69aaaf936f31-istiod-ca-cert\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.421902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421767 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-socket\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.421902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421814 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-envoy\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.421902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421835 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzgmt\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-kube-api-access-jzgmt\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.421902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-credential-socket\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.422126 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421929 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-certs\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.422126 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.421984 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-token\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.523477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523315 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-credential-socket\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.523477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523365 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-certs\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.523477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523399 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-token\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.523477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523432 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-podinfo\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.523477 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523457 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-data\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523508 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b461e696-81b7-43b9-88ef-69aaaf936f31-istiod-ca-cert\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523556 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-socket\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523595 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-envoy\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523617 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzgmt\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-kube-api-access-jzgmt\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523756 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-credential-socket\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524072 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.523892 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-certs\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524384 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.524154 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-socket\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524541 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.524509 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b461e696-81b7-43b9-88ef-69aaaf936f31-istiod-ca-cert\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.524806 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.524781 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-data\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.526409 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.526386 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-envoy\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.526655 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.526635 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-podinfo\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.567880 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.567842 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-token\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.569190 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.569168 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzgmt\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-kube-api-access-jzgmt\") pod \"e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.573129 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.573108 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:40.657145 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.656939 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:40.802660 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.802632 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp"] Jul 16 00:42:40.804790 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:42:40.804749 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb461e696_81b7_43b9_88ef_69aaaf936f31.slice/crio-11502b91101180b0afe7226bda70fe6d2771cd6220aeab22abbf5ebde52173a4 WatchSource:0}: Error finding container 11502b91101180b0afe7226bda70fe6d2771cd6220aeab22abbf5ebde52173a4: Status 404 returned error can't find the container with id 11502b91101180b0afe7226bda70fe6d2771cd6220aeab22abbf5ebde52173a4 Jul 16 00:42:40.806925 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.806896 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:42:40.806996 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.806982 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:42:40.807037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:40.807017 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:42:41.000252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.000221 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:41.063555 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.063470 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" event={"ID":"b461e696-81b7-43b9-88ef-69aaaf936f31","Type":"ContainerStarted","Data":"290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8"} Jul 16 00:42:41.063555 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.063525 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" event={"ID":"b461e696-81b7-43b9-88ef-69aaaf936f31","Type":"ContainerStarted","Data":"11502b91101180b0afe7226bda70fe6d2771cd6220aeab22abbf5ebde52173a4"} Jul 16 00:42:41.131866 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.131801 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" podStartSLOduration=1.13178596 podStartE2EDuration="1.13178596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:42:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:42:41.126198956 +0000 UTC m=+1797.194062244" watchObservedRunningTime="2026-07-16 00:42:41.13178596 +0000 UTC m=+1797.199649247" Jul 16 00:42:41.163805 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.163763 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:41.574205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.574168 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:41.579185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.579159 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:41.775879 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.775842 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:41.881409 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:41.881318 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:42.069639 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:42.069598 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:42.070768 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:42.070746 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:44.102284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:44.102253 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:44.488828 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:44.488805 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:42:44.499087 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:44.499069 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:42:46.566227 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:46.566197 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp"] Jul 16 00:42:46.566645 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:46.566376 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" podUID="b461e696-81b7-43b9-88ef-69aaaf936f31" containerName="istio-proxy" containerID="cri-o://290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8" gracePeriod=30 Jul 16 00:42:46.598885 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:46.598846 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:46.697459 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:46.697374 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:48.438288 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:48.438249 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:51.608203 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.608177 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:51.636482 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636401 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-token\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636482 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636441 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-socket\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636506 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-credential-socket\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636529 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b461e696-81b7-43b9-88ef-69aaaf936f31-istiod-ca-cert\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636574 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jzgmt\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-kube-api-access-jzgmt\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636601 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-certs\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636875 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636739 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-envoy\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636875 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636788 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-podinfo\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.636875 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636814 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-data\") pod \"b461e696-81b7-43b9-88ef-69aaaf936f31\" (UID: \"b461e696-81b7-43b9-88ef-69aaaf936f31\") " Jul 16 00:42:51.637049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.636920 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:42:51.637049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.637031 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b461e696-81b7-43b9-88ef-69aaaf936f31-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:42:51.637186 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.637117 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.637186 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.637137 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b461e696-81b7-43b9-88ef-69aaaf936f31-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.637423 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.637370 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:42:51.637988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.637923 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-data" (OuterVolumeSpecName: "istio-data") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:42:51.638343 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.638307 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:42:51.639575 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.639527 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-token" (OuterVolumeSpecName: "istio-token") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:42:51.639894 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.639870 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:42:51.640010 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.639870 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:42:51.640271 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.640246 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-kube-api-access-jzgmt" (OuterVolumeSpecName: "kube-api-access-jzgmt") pod "b461e696-81b7-43b9-88ef-69aaaf936f31" (UID: "b461e696-81b7-43b9-88ef-69aaaf936f31"). InnerVolumeSpecName "kube-api-access-jzgmt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:42:51.737923 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.737886 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jzgmt\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-kube-api-access-jzgmt\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.737923 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.737918 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.737923 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.737929 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.738187 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.737936 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.738187 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.737944 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.738187 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.737952 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b461e696-81b7-43b9-88ef-69aaaf936f31-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:51.738187 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:51.737986 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b461e696-81b7-43b9-88ef-69aaaf936f31-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:42:52.133370 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.133335 2557 generic.go:356] "Generic (PLEG): container finished" podID="b461e696-81b7-43b9-88ef-69aaaf936f31" containerID="290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8" exitCode=0 Jul 16 00:42:52.133549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.133378 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" Jul 16 00:42:52.133549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.133429 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" event={"ID":"b461e696-81b7-43b9-88ef-69aaaf936f31","Type":"ContainerDied","Data":"290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8"} Jul 16 00:42:52.133549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.133490 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp" event={"ID":"b461e696-81b7-43b9-88ef-69aaaf936f31","Type":"ContainerDied","Data":"11502b91101180b0afe7226bda70fe6d2771cd6220aeab22abbf5ebde52173a4"} Jul 16 00:42:52.133549 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.133514 2557 scope.go:117] "RemoveContainer" containerID="290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8" Jul 16 00:42:52.142844 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.142828 2557 scope.go:117] "RemoveContainer" containerID="290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8" Jul 16 00:42:52.143119 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:42:52.143101 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8\": container with ID starting with 290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8 not found: ID does not exist" containerID="290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8" Jul 16 00:42:52.143177 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.143126 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8"} err="failed to get container status \"290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8\": rpc error: code = NotFound desc = could not find container \"290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8\": container with ID starting with 290a8d1195284ef32078c04220b3c2586765ff10695b8ab1c80ff124ca7a2ef8 not found: ID does not exist" Jul 16 00:42:52.159114 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.159086 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp"] Jul 16 00:42:52.162678 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.162652 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-b9cb77e6-openshift-default-54776958cc-6rlhp"] Jul 16 00:42:52.382872 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:52.382841 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b461e696-81b7-43b9-88ef-69aaaf936f31" path="/var/lib/kubelet/pods/b461e696-81b7-43b9-88ef-69aaaf936f31/volumes" Jul 16 00:42:53.279222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.279188 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:53.348792 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.348752 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:53.546051 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.545936 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:53.654194 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.654162 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:53.714431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.714399 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h"] Jul 16 00:42:53.714831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.714814 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b461e696-81b7-43b9-88ef-69aaaf936f31" containerName="istio-proxy" Jul 16 00:42:53.714919 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.714834 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b461e696-81b7-43b9-88ef-69aaaf936f31" containerName="istio-proxy" Jul 16 00:42:53.715003 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.714925 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b461e696-81b7-43b9-88ef-69aaaf936f31" containerName="istio-proxy" Jul 16 00:42:53.719415 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.719392 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.722556 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.722533 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-4b7f7df8-gw-openshift-default-dockercfg-ctd9n\"" Jul 16 00:42:53.754225 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.754191 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h"] Jul 16 00:42:53.755248 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755224 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-envoy\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755256 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-socket\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755282 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-podinfo\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755309 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f247ed9-d200-4ee2-981b-03e31bee69a1-istiod-ca-cert\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755334 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hw279\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-kube-api-access-hw279\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-credential-socket\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755643 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755395 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-token\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755643 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755466 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-certs\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.755643 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.755506 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-data\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.785792 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.785752 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:53.856222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856126 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-certs\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856169 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-data\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856189 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-envoy\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856206 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-socket\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856345 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-podinfo\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856392 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f247ed9-d200-4ee2-981b-03e31bee69a1-istiod-ca-cert\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856428 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hw279\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-kube-api-access-hw279\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856463 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-credential-socket\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856535 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856496 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-token\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856762 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856606 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-certs\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856789 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-data\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856879 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856853 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-socket\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.856925 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.856854 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-credential-socket\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.857196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.857178 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f247ed9-d200-4ee2-981b-03e31bee69a1-istiod-ca-cert\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.859043 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.859013 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-envoy\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.859237 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.859219 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-podinfo\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.865784 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.865758 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-token\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.866146 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.866123 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hw279\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-kube-api-access-hw279\") pod \"e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:53.885926 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.885894 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:53.987420 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:53.987382 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:54.030436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.030399 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:54.124268 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.124182 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:54.205102 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.205012 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h"] Jul 16 00:42:54.207414 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:42:54.207387 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f247ed9_d200_4ee2_981b_03e31bee69a1.slice/crio-156d3b9fa3a184fdb24c09487bfdedbc7b55149db0ef8ca87b2f8ea6a5241fdc WatchSource:0}: Error finding container 156d3b9fa3a184fdb24c09487bfdedbc7b55149db0ef8ca87b2f8ea6a5241fdc: Status 404 returned error can't find the container with id 156d3b9fa3a184fdb24c09487bfdedbc7b55149db0ef8ca87b2f8ea6a5241fdc Jul 16 00:42:54.209576 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.209542 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:42:54.209665 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.209612 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:42:54.209665 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.209659 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:42:54.741650 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.741617 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:54.841487 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:54.841454 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:55.154419 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:55.154336 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" event={"ID":"0f247ed9-d200-4ee2-981b-03e31bee69a1","Type":"ContainerStarted","Data":"df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d"} Jul 16 00:42:55.154419 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:55.154386 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" event={"ID":"0f247ed9-d200-4ee2-981b-03e31bee69a1","Type":"ContainerStarted","Data":"156d3b9fa3a184fdb24c09487bfdedbc7b55149db0ef8ca87b2f8ea6a5241fdc"} Jul 16 00:42:55.186367 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:55.186320 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" podStartSLOduration=2.18630254 podStartE2EDuration="2.18630254s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:42:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:42:55.184865113 +0000 UTC m=+1811.252728402" watchObservedRunningTime="2026-07-16 00:42:55.18630254 +0000 UTC m=+1811.254165827" Jul 16 00:42:56.031309 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:56.031273 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:56.036380 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:56.036356 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:56.162856 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:56.162824 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:56.163747 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:56.163729 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:42:57.067888 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:57.067856 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:59.588164 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:59.588122 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h"] Jul 16 00:42:59.588670 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:59.588354 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" podUID="0f247ed9-d200-4ee2-981b-03e31bee69a1" containerName="istio-proxy" containerID="cri-o://df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d" gracePeriod=30 Jul 16 00:42:59.608315 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:59.608279 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:42:59.713147 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:42:59.713114 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:01.377243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:01.377209 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:05.648241 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.648213 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:43:05.767171 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767124 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-data\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767220 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-podinfo\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767254 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hw279\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-kube-api-access-hw279\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767278 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-credential-socket\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767301 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-socket\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767325 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-token\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767385 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f247ed9-d200-4ee2-981b-03e31bee69a1-istiod-ca-cert\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767434 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-envoy\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767461 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-certs\") pod \"0f247ed9-d200-4ee2-981b-03e31bee69a1\" (UID: \"0f247ed9-d200-4ee2-981b-03e31bee69a1\") " Jul 16 00:43:05.767817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767628 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:05.767817 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767782 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.768032 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767812 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:05.768032 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767882 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f247ed9-d200-4ee2-981b-03e31bee69a1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:43:05.768032 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.767899 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:05.768214 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.768190 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-data" (OuterVolumeSpecName: "istio-data") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:05.769647 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.769620 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-token" (OuterVolumeSpecName: "istio-token") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:43:05.769748 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.769667 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:43:05.769748 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.769670 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-kube-api-access-hw279" (OuterVolumeSpecName: "kube-api-access-hw279") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "kube-api-access-hw279". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:43:05.769748 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.769688 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0f247ed9-d200-4ee2-981b-03e31bee69a1" (UID: "0f247ed9-d200-4ee2-981b-03e31bee69a1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:05.868487 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868442 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.868487 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868483 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.868487 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868492 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.868487 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868500 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.868487 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868508 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hw279\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-kube-api-access-hw279\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.868793 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868518 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f247ed9-d200-4ee2-981b-03e31bee69a1-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.868793 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868526 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f247ed9-d200-4ee2-981b-03e31bee69a1-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:05.868793 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:05.868533 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f247ed9-d200-4ee2-981b-03e31bee69a1-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:06.009175 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.009141 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:06.108082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.107990 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:06.206717 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.206686 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q"] Jul 16 00:43:06.207098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.207076 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f247ed9-d200-4ee2-981b-03e31bee69a1" containerName="istio-proxy" Jul 16 00:43:06.207098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.207092 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f247ed9-d200-4ee2-981b-03e31bee69a1" containerName="istio-proxy" Jul 16 00:43:06.207248 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.207160 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f247ed9-d200-4ee2-981b-03e31bee69a1" containerName="istio-proxy" Jul 16 00:43:06.210483 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.210464 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.213599 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.213578 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0aafd8c9-openshift-default-dockercfg-j2p8b\"" Jul 16 00:43:06.226935 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.226909 2557 generic.go:356] "Generic (PLEG): container finished" podID="0f247ed9-d200-4ee2-981b-03e31bee69a1" containerID="df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d" exitCode=0 Jul 16 00:43:06.227082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.226949 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" Jul 16 00:43:06.227082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.226996 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" event={"ID":"0f247ed9-d200-4ee2-981b-03e31bee69a1","Type":"ContainerDied","Data":"df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d"} Jul 16 00:43:06.227082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.227053 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h" event={"ID":"0f247ed9-d200-4ee2-981b-03e31bee69a1","Type":"ContainerDied","Data":"156d3b9fa3a184fdb24c09487bfdedbc7b55149db0ef8ca87b2f8ea6a5241fdc"} Jul 16 00:43:06.227082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.227076 2557 scope.go:117] "RemoveContainer" containerID="df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d" Jul 16 00:43:06.233652 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.233626 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q"] Jul 16 00:43:06.237287 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.237267 2557 scope.go:117] "RemoveContainer" containerID="df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d" Jul 16 00:43:06.237558 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:43:06.237537 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d\": container with ID starting with df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d not found: ID does not exist" containerID="df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d" Jul 16 00:43:06.237635 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.237567 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d"} err="failed to get container status \"df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d\": rpc error: code = NotFound desc = could not find container \"df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d\": container with ID starting with df823287e5074504ec83551130f12a676e041bc96eb4d7eedd3aeb96c724f95d not found: ID does not exist" Jul 16 00:43:06.256712 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.256684 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:06.271560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271528 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-socket\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271712 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271579 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24nfq\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-kube-api-access-24nfq\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271712 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271641 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-certs\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271712 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271690 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-credential-socket\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271832 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271723 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-podinfo\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271832 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271743 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istiod-ca-cert\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271832 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271763 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-envoy\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271832 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271795 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-data\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.271832 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.271811 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-token\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.294934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.294897 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h"] Jul 16 00:43:06.301445 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.301419 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-4b7f7df8-gw-openshift-default-69ffc7c795-8vj9h"] Jul 16 00:43:06.372886 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.372808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istiod-ca-cert\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.372886 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.372852 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-envoy\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.372886 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.372884 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-data\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.372907 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-token\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373067 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-socket\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373102 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24nfq\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-kube-api-access-24nfq\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373138 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-certs\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373182 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-credential-socket\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373465 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373215 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-podinfo\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373575 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373551 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-data\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373636 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373591 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-certs\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373636 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373610 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-socket\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373730 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373664 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-credential-socket\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.373837 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.373817 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istiod-ca-cert\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.375245 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.375227 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-envoy\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.375461 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.375441 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-podinfo\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.377092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.377070 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:06.382228 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.382204 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f247ed9-d200-4ee2-981b-03e31bee69a1" path="/var/lib/kubelet/pods/0f247ed9-d200-4ee2-981b-03e31bee69a1/volumes" Jul 16 00:43:06.385838 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.385811 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-token\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.385926 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.385906 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24nfq\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-kube-api-access-24nfq\") pod \"e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.481880 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.481844 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:06.520615 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.520580 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:06.577974 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.577470 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:06.680998 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.680940 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q"] Jul 16 00:43:06.681611 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:43:06.681584 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb48e4c57_96a0_48b2_b5be_2c7079c1bde1.slice/crio-719888ec645a682aad1c69ecabb4f8ce3ff5b2bf276af326f17f0281e3651567 WatchSource:0}: Error finding container 719888ec645a682aad1c69ecabb4f8ce3ff5b2bf276af326f17f0281e3651567: Status 404 returned error can't find the container with id 719888ec645a682aad1c69ecabb4f8ce3ff5b2bf276af326f17f0281e3651567 Jul 16 00:43:06.686404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.684229 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:43:06.686404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.684304 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:43:06.686404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:06.684344 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:43:07.047182 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.047146 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:07.142116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.142083 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:07.236454 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.236414 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" event={"ID":"b48e4c57-96a0-48b2-b5be-2c7079c1bde1","Type":"ContainerStarted","Data":"b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66"} Jul 16 00:43:07.236650 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.236475 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" event={"ID":"b48e4c57-96a0-48b2-b5be-2c7079c1bde1","Type":"ContainerStarted","Data":"719888ec645a682aad1c69ecabb4f8ce3ff5b2bf276af326f17f0281e3651567"} Jul 16 00:43:07.241871 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.241841 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:07.262731 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.262681 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" podStartSLOduration=1.262665211 podStartE2EDuration="1.262665211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:43:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:43:07.259658349 +0000 UTC m=+1823.327521694" watchObservedRunningTime="2026-07-16 00:43:07.262665211 +0000 UTC m=+1823.330528499" Jul 16 00:43:07.521794 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.521762 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:07.526669 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:07.526646 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:08.241854 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:08.241818 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:08.242851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:08.242833 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:09.527386 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:09.527349 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:11.858804 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:11.858759 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q"] Jul 16 00:43:11.859358 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:11.859008 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" podUID="b48e4c57-96a0-48b2-b5be-2c7079c1bde1" containerName="istio-proxy" containerID="cri-o://b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66" gracePeriod=30 Jul 16 00:43:11.896257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:11.896218 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:11.995709 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:11.995661 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:13.723141 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:13.723105 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:16.512641 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.512615 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:16.568486 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568395 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-certs\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568486 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568429 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-24nfq\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-kube-api-access-24nfq\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568486 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568464 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istiod-ca-cert\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568486 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568482 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-token\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568754 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568596 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-podinfo\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568754 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568634 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-data\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568754 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568670 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-credential-socket\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568754 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568689 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-socket\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.568754 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.568733 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-envoy\") pod \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\" (UID: \"b48e4c57-96a0-48b2-b5be-2c7079c1bde1\") " Jul 16 00:43:16.570318 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.570271 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:16.570472 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.570331 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:16.570472 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.570349 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:16.570472 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.570381 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:43:16.571005 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.570957 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-data" (OuterVolumeSpecName: "istio-data") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:16.572171 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.572148 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:43:16.572273 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.572216 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-kube-api-access-24nfq" (OuterVolumeSpecName: "kube-api-access-24nfq") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "kube-api-access-24nfq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:43:16.572373 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.572356 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-token" (OuterVolumeSpecName: "istio-token") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:43:16.572442 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.572424 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b48e4c57-96a0-48b2-b5be-2c7079c1bde1" (UID: "b48e4c57-96a0-48b2-b5be-2c7079c1bde1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:43:16.670340 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670298 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670340 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670331 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-24nfq\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-kube-api-access-24nfq\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670340 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670343 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670354 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670361 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670369 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670376 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670384 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:16.670579 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:16.670392 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b48e4c57-96a0-48b2-b5be-2c7079c1bde1-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:43:17.292051 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.292017 2557 generic.go:356] "Generic (PLEG): container finished" podID="b48e4c57-96a0-48b2-b5be-2c7079c1bde1" containerID="b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66" exitCode=0 Jul 16 00:43:17.292254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.292064 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" Jul 16 00:43:17.292254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.292105 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" event={"ID":"b48e4c57-96a0-48b2-b5be-2c7079c1bde1","Type":"ContainerDied","Data":"b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66"} Jul 16 00:43:17.292254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.292154 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q" event={"ID":"b48e4c57-96a0-48b2-b5be-2c7079c1bde1","Type":"ContainerDied","Data":"719888ec645a682aad1c69ecabb4f8ce3ff5b2bf276af326f17f0281e3651567"} Jul 16 00:43:17.292254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.292173 2557 scope.go:117] "RemoveContainer" containerID="b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66" Jul 16 00:43:17.301422 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.301404 2557 scope.go:117] "RemoveContainer" containerID="b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66" Jul 16 00:43:17.301714 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:43:17.301695 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66\": container with ID starting with b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66 not found: ID does not exist" containerID="b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66" Jul 16 00:43:17.301776 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.301727 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66"} err="failed to get container status \"b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66\": rpc error: code = NotFound desc = could not find container \"b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66\": container with ID starting with b21daf5b7f6fce02be9d00038506f88431a75a0a868ec9b2b90fe146a8a25b66 not found: ID does not exist" Jul 16 00:43:17.317630 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.317596 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q"] Jul 16 00:43:17.319948 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:17.319921 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0aafd8c9-openshift-default-6b6b5f66f9-zw92q"] Jul 16 00:43:18.220651 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:18.220617 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:18.323114 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:18.323081 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:18.382778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:18.382743 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b48e4c57-96a0-48b2-b5be-2c7079c1bde1" path="/var/lib/kubelet/pods/b48e4c57-96a0-48b2-b5be-2c7079c1bde1/volumes" Jul 16 00:43:18.690948 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:18.690921 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:18.799569 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:18.799535 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:20.238234 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:20.238200 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:26.249546 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:26.249510 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:26.524147 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:26.524063 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:26.925478 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:26.925394 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:27.236871 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:27.236843 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:53.210388 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:53.210357 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:59.012466 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:59.012434 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:59.124082 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:59.124050 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:43:59.216798 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:43:59.216762 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:15.157264 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:15.157181 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:21.483956 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:21.483920 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:21.590638 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:21.590605 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:21.690037 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:21.689999 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:32.242046 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:32.242007 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:33.054436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:33.054402 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:39.309432 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:39.309388 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:39.416616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:39.416579 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:39.508602 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:39.508569 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:39.613818 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:39.613730 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:40.480409 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:40.480378 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:40.591304 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:40.591267 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:42.366564 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:42.366532 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:48.970803 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:48.970769 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:49.078805 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:49.078770 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:49.673823 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:49.673786 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:56.312674 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.312635 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:56.410069 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.410040 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:56.565232 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.565152 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:56.940809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.940721 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s"] Jul 16 00:44:56.941171 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.941155 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b48e4c57-96a0-48b2-b5be-2c7079c1bde1" containerName="istio-proxy" Jul 16 00:44:56.941219 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.941175 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b48e4c57-96a0-48b2-b5be-2c7079c1bde1" containerName="istio-proxy" Jul 16 00:44:56.941254 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.941245 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b48e4c57-96a0-48b2-b5be-2c7079c1bde1" containerName="istio-proxy" Jul 16 00:44:56.944304 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.944288 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:56.948135 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.948115 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-19434bf7-openshift-default-dockercfg-mksxt\"" Jul 16 00:44:56.993154 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.993125 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s"] Jul 16 00:44:56.993311 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:56.993210 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:57.027897 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.027864 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-certs\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.027897 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.027899 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa05a12-675f-4d90-a971-242acf8dc540-istio-podinfo\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.028178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.027931 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-credential-socket\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.028178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.028077 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa05a12-675f-4d90-a971-242acf8dc540-istiod-ca-cert\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.028178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.028112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-istio-token\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.028178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.028138 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rprx2\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-kube-api-access-rprx2\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.028178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.028176 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-socket\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.028385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.028204 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-envoy\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.028385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.028241 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-data\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.090426 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.090392 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:57.129660 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129621 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-credential-socket\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.129846 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129701 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa05a12-675f-4d90-a971-242acf8dc540-istiod-ca-cert\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.129846 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129729 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-istio-token\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.129846 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rprx2\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-kube-api-access-rprx2\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.129846 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129781 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-socket\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.129846 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129808 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-envoy\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.129846 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129833 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-data\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.130172 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129867 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-certs\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.130172 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.129897 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa05a12-675f-4d90-a971-242acf8dc540-istio-podinfo\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.130277 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.130177 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-socket\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.130277 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.130267 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-data\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.130386 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.130290 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-credential-socket\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.130386 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.130330 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-certs\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.130460 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.130436 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa05a12-675f-4d90-a971-242acf8dc540-istiod-ca-cert\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.132007 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.131956 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-envoy\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.132349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.132329 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa05a12-675f-4d90-a971-242acf8dc540-istio-podinfo\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.140716 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.140693 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-istio-token\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.141055 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.141032 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rprx2\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-kube-api-access-rprx2\") pod \"e2e-mt-19434bf7-openshift-default-d454767ff-xt27s\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.257461 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.257426 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:57.407934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.407908 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s"] Jul 16 00:44:57.410210 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:44:57.410179 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1aa05a12_675f_4d90_a971_242acf8dc540.slice/crio-8101a7a4c38286545f31d1d32fd5452168303aea12410be0a398478e4492133a WatchSource:0}: Error finding container 8101a7a4c38286545f31d1d32fd5452168303aea12410be0a398478e4492133a: Status 404 returned error can't find the container with id 8101a7a4c38286545f31d1d32fd5452168303aea12410be0a398478e4492133a Jul 16 00:44:57.412195 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.412164 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:44:57.412290 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.412230 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:44:57.412290 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.412260 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:44:57.807421 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.807391 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" event={"ID":"1aa05a12-675f-4d90-a971-242acf8dc540","Type":"ContainerStarted","Data":"35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da"} Jul 16 00:44:57.807638 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.807451 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" event={"ID":"1aa05a12-675f-4d90-a971-242acf8dc540","Type":"ContainerStarted","Data":"8101a7a4c38286545f31d1d32fd5452168303aea12410be0a398478e4492133a"} Jul 16 00:44:57.836788 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:57.836730 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" podStartSLOduration=1.836709456 podStartE2EDuration="1.836709456s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:44:57.832785228 +0000 UTC m=+1933.900648520" watchObservedRunningTime="2026-07-16 00:44:57.836709456 +0000 UTC m=+1933.904572744" Jul 16 00:44:58.258556 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:58.258525 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:58.263747 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:58.263725 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:58.801268 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:58.801236 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:58.816134 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:58.816106 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:58.817067 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:58.817047 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:44:58.909118 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:58.909088 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:59.006205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:59.006171 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:59.233043 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:59.233014 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:59.615446 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:59.615356 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:44:59.715582 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:44:59.715537 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:00.142541 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.142475 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl"] Jul 16 00:45:00.146722 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.146699 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5"] Jul 16 00:45:00.146848 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.146799 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" Jul 16 00:45:00.150106 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.150083 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn"] Jul 16 00:45:00.150106 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.150091 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-qks69\"" Jul 16 00:45:00.150273 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.150189 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" Jul 16 00:45:00.153863 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.153841 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n"] Jul 16 00:45:00.153986 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.153946 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn" Jul 16 00:45:00.157654 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.157635 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl"] Jul 16 00:45:00.157742 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.157726 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" Jul 16 00:45:00.158955 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.158939 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" Jul 16 00:45:00.166098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.166073 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n"] Jul 16 00:45:00.167771 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.167753 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" Jul 16 00:45:00.169029 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.169009 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5"] Jul 16 00:45:00.195225 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.195191 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn"] Jul 16 00:45:00.205269 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.205245 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn" Jul 16 00:45:00.214213 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.214183 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" Jul 16 00:45:00.342837 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.342715 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl"] Jul 16 00:45:00.343895 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:45:00.343712 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e2397d_f900_4ef0_9458_5589640e6c24.slice/crio-0b9b223e00563b1cdbc7e3fd67a5b890b3a33c0580728c83552bd0632bd3d770 WatchSource:0}: Error finding container 0b9b223e00563b1cdbc7e3fd67a5b890b3a33c0580728c83552bd0632bd3d770: Status 404 returned error can't find the container with id 0b9b223e00563b1cdbc7e3fd67a5b890b3a33c0580728c83552bd0632bd3d770 Jul 16 00:45:00.424030 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.424008 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n"] Jul 16 00:45:00.424867 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:45:00.424846 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeca7c12_8b31_4047_be92_a92bfd922ce4.slice/crio-03c4cf6288ab1dbeee8641b6a1230e4625543c0f84fcca8d1089334ba06f76b1 WatchSource:0}: Error finding container 03c4cf6288ab1dbeee8641b6a1230e4625543c0f84fcca8d1089334ba06f76b1: Status 404 returned error can't find the container with id 03c4cf6288ab1dbeee8641b6a1230e4625543c0f84fcca8d1089334ba06f76b1 Jul 16 00:45:00.579820 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:45:00.579787 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57cc832_753b_4d3f_a419_e766191633dc.slice/crio-3911c57016592274caae96ecbd10fbb6a3f26954227e2eb6f0fd8a0cb1692c8e WatchSource:0}: Error finding container 3911c57016592274caae96ecbd10fbb6a3f26954227e2eb6f0fd8a0cb1692c8e: Status 404 returned error can't find the container with id 3911c57016592274caae96ecbd10fbb6a3f26954227e2eb6f0fd8a0cb1692c8e Jul 16 00:45:00.579986 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.579863 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5"] Jul 16 00:45:00.606015 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.605990 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn"] Jul 16 00:45:00.607012 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:45:00.606991 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3067561e_31b4_41b7_af6d_76f71b4581a6.slice/crio-70e107e4abb95f56f37975ddf6b71960db813b1b522b479bee80884b8c371042 WatchSource:0}: Error finding container 70e107e4abb95f56f37975ddf6b71960db813b1b522b479bee80884b8c371042: Status 404 returned error can't find the container with id 70e107e4abb95f56f37975ddf6b71960db813b1b522b479bee80884b8c371042 Jul 16 00:45:00.827074 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.827039 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" event={"ID":"eeca7c12-8b31-4047-be92-a92bfd922ce4","Type":"ContainerStarted","Data":"de8d57c5961d21f88f25969a5169a2324eb0c3656aa9cc083b26ed62357ba895"} Jul 16 00:45:00.827204 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.827096 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" event={"ID":"eeca7c12-8b31-4047-be92-a92bfd922ce4","Type":"ContainerStarted","Data":"03c4cf6288ab1dbeee8641b6a1230e4625543c0f84fcca8d1089334ba06f76b1"} Jul 16 00:45:00.828218 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.828190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn" event={"ID":"3067561e-31b4-41b7-af6d-76f71b4581a6","Type":"ContainerStarted","Data":"70e107e4abb95f56f37975ddf6b71960db813b1b522b479bee80884b8c371042"} Jul 16 00:45:00.829339 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.829315 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" event={"ID":"a57cc832-753b-4d3f-a419-e766191633dc","Type":"ContainerStarted","Data":"3911c57016592274caae96ecbd10fbb6a3f26954227e2eb6f0fd8a0cb1692c8e"} Jul 16 00:45:00.830753 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.830730 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" event={"ID":"b3e2397d-f900-4ef0-9458-5589640e6c24","Type":"ContainerStarted","Data":"6ad7f5d5d95096aae2bb427a5383fe76757ac9192a2ab2e8000cf04369d49990"} Jul 16 00:45:00.830844 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.830772 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" event={"ID":"b3e2397d-f900-4ef0-9458-5589640e6c24","Type":"ContainerStarted","Data":"0b9b223e00563b1cdbc7e3fd67a5b890b3a33c0580728c83552bd0632bd3d770"} Jul 16 00:45:00.846850 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.846807 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" podStartSLOduration=0.846795332 podStartE2EDuration="846.795332ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:00.84483846 +0000 UTC m=+1936.912701773" watchObservedRunningTime="2026-07-16 00:45:00.846795332 +0000 UTC m=+1936.914658598" Jul 16 00:45:00.862320 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:00.862283 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" podStartSLOduration=0.86227004 podStartE2EDuration="862.27004ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:00.860139442 +0000 UTC m=+1936.928002730" watchObservedRunningTime="2026-07-16 00:45:00.86227004 +0000 UTC m=+1936.930133327" Jul 16 00:45:01.837799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.837766 2557 generic.go:356] "Generic (PLEG): container finished" podID="eeca7c12-8b31-4047-be92-a92bfd922ce4" containerID="de8d57c5961d21f88f25969a5169a2324eb0c3656aa9cc083b26ed62357ba895" exitCode=0 Jul 16 00:45:01.838200 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.837850 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" event={"ID":"eeca7c12-8b31-4047-be92-a92bfd922ce4","Type":"ContainerDied","Data":"de8d57c5961d21f88f25969a5169a2324eb0c3656aa9cc083b26ed62357ba895"} Jul 16 00:45:01.839551 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.839528 2557 generic.go:356] "Generic (PLEG): container finished" podID="3067561e-31b4-41b7-af6d-76f71b4581a6" containerID="d4e59710c9e3fcd0db22dbbfca426c063fe0d574645d714c6e36a3a5f6a3c7a9" exitCode=0 Jul 16 00:45:01.839660 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.839614 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn" event={"ID":"3067561e-31b4-41b7-af6d-76f71b4581a6","Type":"ContainerDied","Data":"d4e59710c9e3fcd0db22dbbfca426c063fe0d574645d714c6e36a3a5f6a3c7a9"} Jul 16 00:45:01.841062 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.841043 2557 generic.go:356] "Generic (PLEG): container finished" podID="a57cc832-753b-4d3f-a419-e766191633dc" containerID="41bf59b7e4cfae75f81b55a151ecbe93ebb108ee3128e2ebe2e7ec24e5074e1f" exitCode=7 Jul 16 00:45:01.841131 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.841102 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" event={"ID":"a57cc832-753b-4d3f-a419-e766191633dc","Type":"ContainerDied","Data":"41bf59b7e4cfae75f81b55a151ecbe93ebb108ee3128e2ebe2e7ec24e5074e1f"} Jul 16 00:45:01.841256 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.841242 2557 scope.go:117] "RemoveContainer" containerID="41bf59b7e4cfae75f81b55a151ecbe93ebb108ee3128e2ebe2e7ec24e5074e1f" Jul 16 00:45:01.842684 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.842664 2557 generic.go:356] "Generic (PLEG): container finished" podID="b3e2397d-f900-4ef0-9458-5589640e6c24" containerID="6ad7f5d5d95096aae2bb427a5383fe76757ac9192a2ab2e8000cf04369d49990" exitCode=0 Jul 16 00:45:01.842761 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:01.842689 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" event={"ID":"b3e2397d-f900-4ef0-9458-5589640e6c24","Type":"ContainerDied","Data":"6ad7f5d5d95096aae2bb427a5383fe76757ac9192a2ab2e8000cf04369d49990"} Jul 16 00:45:02.850185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:02.850085 2557 generic.go:356] "Generic (PLEG): container finished" podID="a57cc832-753b-4d3f-a419-e766191633dc" containerID="db1998f2013636f517b26c3aa83526317e1b00a08fd0ef77947d134ea70b407e" exitCode=7 Jul 16 00:45:02.850185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:02.850163 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" event={"ID":"a57cc832-753b-4d3f-a419-e766191633dc","Type":"ContainerDied","Data":"db1998f2013636f517b26c3aa83526317e1b00a08fd0ef77947d134ea70b407e"} Jul 16 00:45:02.850701 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:02.850228 2557 scope.go:117] "RemoveContainer" containerID="41bf59b7e4cfae75f81b55a151ecbe93ebb108ee3128e2ebe2e7ec24e5074e1f" Jul 16 00:45:02.850701 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:02.850362 2557 scope.go:117] "RemoveContainer" containerID="db1998f2013636f517b26c3aa83526317e1b00a08fd0ef77947d134ea70b407e" Jul 16 00:45:02.851219 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:45:02.850700 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5_odh-ai-gateway-infra(a57cc832-753b-4d3f-a419-e766191633dc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" podUID="a57cc832-753b-4d3f-a419-e766191633dc" Jul 16 00:45:03.009297 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.009269 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" Jul 16 00:45:03.040213 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.040190 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn" Jul 16 00:45:03.048725 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.048705 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" Jul 16 00:45:03.856385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.856357 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" Jul 16 00:45:03.856883 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.856356 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n" event={"ID":"eeca7c12-8b31-4047-be92-a92bfd922ce4","Type":"ContainerDied","Data":"03c4cf6288ab1dbeee8641b6a1230e4625543c0f84fcca8d1089334ba06f76b1"} Jul 16 00:45:03.856883 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.856472 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="03c4cf6288ab1dbeee8641b6a1230e4625543c0f84fcca8d1089334ba06f76b1" Jul 16 00:45:03.857573 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.857556 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn" Jul 16 00:45:03.857676 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.857596 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn" event={"ID":"3067561e-31b4-41b7-af6d-76f71b4581a6","Type":"ContainerDied","Data":"70e107e4abb95f56f37975ddf6b71960db813b1b522b479bee80884b8c371042"} Jul 16 00:45:03.857676 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.857638 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="70e107e4abb95f56f37975ddf6b71960db813b1b522b479bee80884b8c371042" Jul 16 00:45:03.859367 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.859349 2557 scope.go:117] "RemoveContainer" containerID="db1998f2013636f517b26c3aa83526317e1b00a08fd0ef77947d134ea70b407e" Jul 16 00:45:03.859567 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:45:03.859546 2557 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5_odh-ai-gateway-infra(a57cc832-753b-4d3f-a419-e766191633dc)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" podUID="a57cc832-753b-4d3f-a419-e766191633dc" Jul 16 00:45:03.860591 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.860574 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" Jul 16 00:45:03.860591 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.860580 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29736045-r49sl" event={"ID":"b3e2397d-f900-4ef0-9458-5589640e6c24","Type":"ContainerDied","Data":"0b9b223e00563b1cdbc7e3fd67a5b890b3a33c0580728c83552bd0632bd3d770"} Jul 16 00:45:03.860740 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:03.860615 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0b9b223e00563b1cdbc7e3fd67a5b890b3a33c0580728c83552bd0632bd3d770" Jul 16 00:45:04.328641 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:04.328608 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:05.041120 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:05.041085 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:05.144121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:05.144086 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:05.462197 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:05.462113 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:10.905808 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:10.905777 2557 generic.go:356] "Generic (PLEG): container finished" podID="1aa05a12-675f-4d90-a971-242acf8dc540" containerID="35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da" exitCode=0 Jul 16 00:45:10.906278 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:10.905858 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" event={"ID":"1aa05a12-675f-4d90-a971-242acf8dc540","Type":"ContainerDied","Data":"35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da"} Jul 16 00:45:10.906320 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:10.906293 2557 scope.go:117] "RemoveContainer" containerID="35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da" Jul 16 00:45:10.907273 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:10.907250 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:45:10.907325 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:10.907310 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:45:10.907359 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:10.907339 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:45:11.914778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:11.914737 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" event={"ID":"1aa05a12-675f-4d90-a971-242acf8dc540","Type":"ContainerStarted","Data":"bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de"} Jul 16 00:45:12.022382 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:12.022348 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:12.092897 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:12.092776 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:12.258626 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:12.258595 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:45:12.259755 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:12.259730 2557 patch_prober.go:28] interesting pod/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 16 00:45:12.259880 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:12.259775 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 16 00:45:12.787392 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:12.787292 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:13.258757 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:13.258718 2557 patch_prober.go:28] interesting pod/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 16 00:45:13.259243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:13.258793 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 16 00:45:13.816298 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:13.816261 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:45:14.257940 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:14.257906 2557 patch_prober.go:28] interesting pod/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 16 00:45:14.258123 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:14.257995 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 16 00:45:15.258020 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:15.257958 2557 patch_prober.go:28] interesting pod/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" start-of-body= Jul 16 00:45:15.258413 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:15.258039 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.49:15021/healthz/ready\": dial tcp 10.132.0.49:15021: connect: connection refused" Jul 16 00:45:16.262624 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:16.262589 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:45:16.263525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:16.263505 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:45:18.981169 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:18.981139 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:19.080831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.080796 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:19.249874 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.249783 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s"] Jul 16 00:45:19.250053 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.250035 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" containerID="cri-o://bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de" gracePeriod=30 Jul 16 00:45:19.283759 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.283729 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:19.377615 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.377584 2557 scope.go:117] "RemoveContainer" containerID="db1998f2013636f517b26c3aa83526317e1b00a08fd0ef77947d134ea70b407e" Jul 16 00:45:19.502258 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.502173 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:19.709765 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.709733 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:19.805425 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.805336 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:19.906405 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.906370 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:19.961121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.961086 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" event={"ID":"a57cc832-753b-4d3f-a419-e766191633dc","Type":"ContainerStarted","Data":"16d82486ab4e6a04814701001fc4b1e22916fb3cf713bcf9ccf7bc750275c3c4"} Jul 16 00:45:19.984026 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:19.983953 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" podStartSLOduration=19.983936916 podStartE2EDuration="19.983936916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:45:19.982112215 +0000 UTC m=+1956.049975503" watchObservedRunningTime="2026-07-16 00:45:19.983936916 +0000 UTC m=+1956.051800203" Jul 16 00:45:20.974413 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:20.974381 2557 generic.go:356] "Generic (PLEG): container finished" podID="a57cc832-753b-4d3f-a419-e766191633dc" containerID="16d82486ab4e6a04814701001fc4b1e22916fb3cf713bcf9ccf7bc750275c3c4" exitCode=0 Jul 16 00:45:20.974622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:20.974461 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" event={"ID":"a57cc832-753b-4d3f-a419-e766191633dc","Type":"ContainerDied","Data":"16d82486ab4e6a04814701001fc4b1e22916fb3cf713bcf9ccf7bc750275c3c4"} Jul 16 00:45:20.974622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:20.974544 2557 scope.go:117] "RemoveContainer" containerID="db1998f2013636f517b26c3aa83526317e1b00a08fd0ef77947d134ea70b407e" Jul 16 00:45:20.993485 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:20.993457 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5"] Jul 16 00:45:22.115647 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:22.115622 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" Jul 16 00:45:22.988873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:22.988845 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" Jul 16 00:45:22.988873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:22.988856 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5" event={"ID":"a57cc832-753b-4d3f-a419-e766191633dc","Type":"ContainerDied","Data":"3911c57016592274caae96ecbd10fbb6a3f26954227e2eb6f0fd8a0cb1692c8e"} Jul 16 00:45:22.989117 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:22.988905 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3911c57016592274caae96ecbd10fbb6a3f26954227e2eb6f0fd8a0cb1692c8e" Jul 16 00:45:23.021131 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:23.021093 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5"] Jul 16 00:45:23.026060 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:23.026034 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-19434bf7-29736045-wsxf5"] Jul 16 00:45:24.383978 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.383932 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a57cc832-753b-4d3f-a419-e766191633dc" path="/var/lib/kubelet/pods/a57cc832-753b-4d3f-a419-e766191633dc/volumes" Jul 16 00:45:24.512365 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.512339 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:45:24.691500 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691409 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-envoy\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691500 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691457 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-data\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691500 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691491 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-socket\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691519 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-credential-socket\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691567 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-istio-token\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691600 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-certs\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691624 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rprx2\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-kube-api-access-rprx2\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691654 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa05a12-675f-4d90-a971-242acf8dc540-istio-podinfo\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.691744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691696 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa05a12-675f-4d90-a971-242acf8dc540-istiod-ca-cert\") pod \"1aa05a12-675f-4d90-a971-242acf8dc540\" (UID: \"1aa05a12-675f-4d90-a971-242acf8dc540\") " Jul 16 00:45:24.692089 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691798 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:24.692089 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.691814 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:24.692089 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.692061 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.692089 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.692081 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.692279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.692180 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:24.692279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.692207 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1aa05a12-675f-4d90-a971-242acf8dc540-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:45:24.692543 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.692520 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-data" (OuterVolumeSpecName: "istio-data") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:24.693691 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.693670 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:45:24.693937 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.693918 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-kube-api-access-rprx2" (OuterVolumeSpecName: "kube-api-access-rprx2") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "kube-api-access-rprx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:45:24.694052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.694036 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1aa05a12-675f-4d90-a971-242acf8dc540-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:45:24.694113 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.694066 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-istio-token" (OuterVolumeSpecName: "istio-token") pod "1aa05a12-675f-4d90-a971-242acf8dc540" (UID: "1aa05a12-675f-4d90-a971-242acf8dc540"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:45:24.792675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.792643 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.792675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.792669 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.792675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.792677 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.792675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.792685 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1aa05a12-675f-4d90-a971-242acf8dc540-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.792944 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.792695 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rprx2\" (UniqueName: \"kubernetes.io/projected/1aa05a12-675f-4d90-a971-242acf8dc540-kube-api-access-rprx2\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.792944 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.792703 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1aa05a12-675f-4d90-a971-242acf8dc540-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:24.792944 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:24.792711 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1aa05a12-675f-4d90-a971-242acf8dc540-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:45:25.000976 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.000927 2557 generic.go:356] "Generic (PLEG): container finished" podID="1aa05a12-675f-4d90-a971-242acf8dc540" containerID="bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de" exitCode=0 Jul 16 00:45:25.001138 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.001004 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" Jul 16 00:45:25.001138 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.001012 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" event={"ID":"1aa05a12-675f-4d90-a971-242acf8dc540","Type":"ContainerDied","Data":"bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de"} Jul 16 00:45:25.001138 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.001064 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s" event={"ID":"1aa05a12-675f-4d90-a971-242acf8dc540","Type":"ContainerDied","Data":"8101a7a4c38286545f31d1d32fd5452168303aea12410be0a398478e4492133a"} Jul 16 00:45:25.001138 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.001085 2557 scope.go:117] "RemoveContainer" containerID="bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de" Jul 16 00:45:25.010666 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.010649 2557 scope.go:117] "RemoveContainer" containerID="35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da" Jul 16 00:45:25.018648 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.018628 2557 scope.go:117] "RemoveContainer" containerID="bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de" Jul 16 00:45:25.018912 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:45:25.018890 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de\": container with ID starting with bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de not found: ID does not exist" containerID="bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de" Jul 16 00:45:25.018946 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.018922 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de"} err="failed to get container status \"bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de\": rpc error: code = NotFound desc = could not find container \"bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de\": container with ID starting with bb3098571d8051e063dc6137117c85529b261949e79ccb109c3b06eb4e1e38de not found: ID does not exist" Jul 16 00:45:25.018996 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.018945 2557 scope.go:117] "RemoveContainer" containerID="35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da" Jul 16 00:45:25.019182 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:45:25.019167 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da\": container with ID starting with 35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da not found: ID does not exist" containerID="35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da" Jul 16 00:45:25.019221 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.019188 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da"} err="failed to get container status \"35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da\": rpc error: code = NotFound desc = could not find container \"35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da\": container with ID starting with 35d6da27f842fbdffc6221c30ef59e9af7c35302c8d52fceb9ab6c677ca028da not found: ID does not exist" Jul 16 00:45:25.024502 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.024478 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s"] Jul 16 00:45:25.029939 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:25.029919 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-19434bf7-openshift-default-d454767ff-xt27s"] Jul 16 00:45:26.256356 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:26.256323 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:26.389052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:26.389021 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" path="/var/lib/kubelet/pods/1aa05a12-675f-4d90-a971-242acf8dc540/volumes" Jul 16 00:45:26.432057 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:26.432004 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:26.626591 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:26.626507 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:26.719712 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:26.719680 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:32.686702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:32.686661 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:32.763745 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:32.763715 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:37.888246 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:37.888160 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:37.988245 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:37.988212 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:40.450122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:40.450090 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:40.543795 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:40.543758 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:40.730242 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:40.730155 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:41.457111 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:41.457077 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:41.563226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:41.563165 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:43.034637 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:43.034598 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:49.055727 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:49.055696 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:49.157698 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:49.157669 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:49.747412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:49.747379 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:55.815154 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:55.815118 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:55.928526 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:55.928490 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:45:56.044152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:45:56.044117 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:06.557348 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:06.557319 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:06.912758 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:06.912726 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:27.886394 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:27.886358 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:34.354405 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:34.354370 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:34.459925 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:34.459889 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:34.729714 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:34.729621 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:35.161014 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.160981 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c"] Jul 16 00:46:35.161340 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161327 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3067561e-31b4-41b7-af6d-76f71b4581a6" containerName="cleanup" Jul 16 00:46:35.161340 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161340 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="3067561e-31b4-41b7-af6d-76f71b4581a6" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161356 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161362 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161372 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161378 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161388 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eeca7c12-8b31-4047-be92-a92bfd922ce4" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161393 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="eeca7c12-8b31-4047-be92-a92bfd922ce4" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161400 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3e2397d-f900-4ef0-9458-5589640e6c24" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161405 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3e2397d-f900-4ef0-9458-5589640e6c24" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161412 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161417 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161425 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:35.161431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161430 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:35.161831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161481 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:35.161831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161487 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="eeca7c12-8b31-4047-be92-a92bfd922ce4" containerName="cleanup" Jul 16 00:46:35.161831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161494 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" Jul 16 00:46:35.161831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161500 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="1aa05a12-675f-4d90-a971-242acf8dc540" containerName="istio-proxy" Jul 16 00:46:35.161831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161507 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="3067561e-31b4-41b7-af6d-76f71b4581a6" containerName="cleanup" Jul 16 00:46:35.161831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161514 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3e2397d-f900-4ef0-9458-5589640e6c24" containerName="cleanup" Jul 16 00:46:35.161831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.161520 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:35.164544 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.164528 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.169688 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.169668 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a70600-openshift-default-dockercfg-2dsc7\"" Jul 16 00:46:35.191940 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.191907 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c"] Jul 16 00:46:35.200178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.200155 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:35.220238 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220205 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-credential-socket\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220238 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220242 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-podinfo\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220263 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-socket\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220285 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-certs\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220319 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-token\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220360 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-data\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220386 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4c85\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-kube-api-access-s4c85\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220407 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c82220-b8f8-44d1-9a90-b12fc1102974-istiod-ca-cert\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.220628 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.220429 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-envoy\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.321690 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321654 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-envoy\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.321867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321730 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-credential-socket\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.321867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321755 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-podinfo\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.321867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321779 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-socket\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.321867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321796 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-certs\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.321867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321815 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-token\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.321867 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321849 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-data\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.322212 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321880 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4c85\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-kube-api-access-s4c85\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.322212 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.321911 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c82220-b8f8-44d1-9a90-b12fc1102974-istiod-ca-cert\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.322317 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.322278 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-certs\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.322375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.322330 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-data\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.322458 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.322438 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-credential-socket\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.322524 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.322505 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-socket\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.322620 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.322604 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c82220-b8f8-44d1-9a90-b12fc1102974-istiod-ca-cert\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.324376 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.324356 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-podinfo\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.324451 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.324358 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-envoy\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.330660 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.330637 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-token\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.331177 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.331159 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4c85\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-kube-api-access-s4c85\") pod \"e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.396146 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.396120 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:35.475271 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.475189 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:35.613741 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.613303 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c"] Jul 16 00:46:35.615718 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:46:35.615686 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c82220_b8f8_44d1_9a90_b12fc1102974.slice/crio-bac5af14a4612e6863316351cac3ec306df5876ee18633a65a3ee0050918aa4c WatchSource:0}: Error finding container bac5af14a4612e6863316351cac3ec306df5876ee18633a65a3ee0050918aa4c: Status 404 returned error can't find the container with id bac5af14a4612e6863316351cac3ec306df5876ee18633a65a3ee0050918aa4c Jul 16 00:46:35.618290 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.618259 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:46:35.618375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.618321 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:46:35.618375 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:35.618351 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:46:36.393196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:36.393160 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" event={"ID":"55c82220-b8f8-44d1-9a90-b12fc1102974","Type":"ContainerStarted","Data":"bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e"} Jul 16 00:46:36.393373 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:36.393216 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" event={"ID":"55c82220-b8f8-44d1-9a90-b12fc1102974","Type":"ContainerStarted","Data":"bac5af14a4612e6863316351cac3ec306df5876ee18633a65a3ee0050918aa4c"} Jul 16 00:46:36.424584 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:36.424536 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" podStartSLOduration=1.424521546 podStartE2EDuration="1.424521546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:46:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:46:36.421812173 +0000 UTC m=+2032.489675461" watchObservedRunningTime="2026-07-16 00:46:36.424521546 +0000 UTC m=+2032.492384834" Jul 16 00:46:36.476217 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:36.476185 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:36.480712 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:36.480689 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:37.399054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.399023 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:37.399868 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.399840 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:37.501395 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.501366 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:37.621784 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.621754 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7"] Jul 16 00:46:37.622166 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.622153 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:37.622221 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.622168 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:37.622255 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.622245 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="a57cc832-753b-4d3f-a419-e766191633dc" containerName="cleanup" Jul 16 00:46:37.625546 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.625529 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.629152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.629127 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-a70600-serving-cert\"" Jul 16 00:46:37.629152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.629154 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-n869x\"" Jul 16 00:46:37.629152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.629180 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 16 00:46:37.629426 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.629344 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 16 00:46:37.650704 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.650631 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7"] Jul 16 00:46:37.686252 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.686226 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:37.742094 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.742064 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de04c8b6-2aaf-4343-911c-72ec83f92659-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.742257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.742112 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de04c8b6-2aaf-4343-911c-72ec83f92659-maas-api-tls\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.742257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.742170 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftc7v\" (UniqueName: \"kubernetes.io/projected/de04c8b6-2aaf-4343-911c-72ec83f92659-kube-api-access-ftc7v\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.813886 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.813856 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:37.842870 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.842843 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de04c8b6-2aaf-4343-911c-72ec83f92659-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.843015 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.842881 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de04c8b6-2aaf-4343-911c-72ec83f92659-maas-api-tls\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.843015 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.842910 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftc7v\" (UniqueName: \"kubernetes.io/projected/de04c8b6-2aaf-4343-911c-72ec83f92659-kube-api-access-ftc7v\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.843520 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.843496 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/de04c8b6-2aaf-4343-911c-72ec83f92659-openshift-service-ca\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.845222 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.845204 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/de04c8b6-2aaf-4343-911c-72ec83f92659-maas-api-tls\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.862413 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.862392 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftc7v\" (UniqueName: \"kubernetes.io/projected/de04c8b6-2aaf-4343-911c-72ec83f92659-kube-api-access-ftc7v\") pod \"maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7\" (UID: \"de04c8b6-2aaf-4343-911c-72ec83f92659\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:37.915223 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.915129 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:37.938238 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:37.938214 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:38.081443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:38.081402 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7"] Jul 16 00:46:38.081577 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:46:38.081549 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde04c8b6_2aaf_4343_911c_72ec83f92659.slice/crio-915bcb95011f6fc7aeabac51eb88d753875a2718a51895812457f9bd5482e8c1 WatchSource:0}: Error finding container 915bcb95011f6fc7aeabac51eb88d753875a2718a51895812457f9bd5482e8c1: Status 404 returned error can't find the container with id 915bcb95011f6fc7aeabac51eb88d753875a2718a51895812457f9bd5482e8c1 Jul 16 00:46:38.083103 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:38.083083 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:46:38.398995 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:38.398947 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:38.404628 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:38.404594 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" event={"ID":"de04c8b6-2aaf-4343-911c-72ec83f92659","Type":"ContainerStarted","Data":"915bcb95011f6fc7aeabac51eb88d753875a2718a51895812457f9bd5482e8c1"} Jul 16 00:46:38.496656 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:38.496616 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:40.418427 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:40.418400 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" event={"ID":"de04c8b6-2aaf-4343-911c-72ec83f92659","Type":"ContainerStarted","Data":"bed773801930504d742cc877a3e7e0d19d300defcbc2733577b8a87814ee6fc2"} Jul 16 00:46:40.418768 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:40.418553 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:40.444770 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:40.444725 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" podStartSLOduration=1.171712852 podStartE2EDuration="3.444712159s" totalImagesPullingTime="2.272999307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:46:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:46:40.442334919 +0000 UTC m=+2036.510198206" watchObservedRunningTime="2026-07-16 00:46:40.444712159 +0000 UTC m=+2036.512575446" Jul 16 00:46:42.934911 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:42.934881 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:43.272264 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:43.272232 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:43.629694 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:43.629616 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:43.769836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:43.769800 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:45.154123 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:45.154065 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:45.315408 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:45.315377 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:45.496094 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:45.496059 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:45.706184 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:45.706158 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:46.039202 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:46.039173 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:46.137260 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:46.137235 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:46.429020 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:46.428922 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7" Jul 16 00:46:50.641485 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:50.641450 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:55.504947 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:55.504919 2557 generic.go:356] "Generic (PLEG): container finished" podID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerID="bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e" exitCode=0 Jul 16 00:46:55.505359 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:55.504991 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" event={"ID":"55c82220-b8f8-44d1-9a90-b12fc1102974","Type":"ContainerDied","Data":"bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e"} Jul 16 00:46:55.505359 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:55.505307 2557 scope.go:117] "RemoveContainer" containerID="bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e" Jul 16 00:46:55.506327 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:55.506305 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:46:55.506386 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:55.506367 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:46:55.506424 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:55.506412 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:46:56.512371 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:56.512338 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" event={"ID":"55c82220-b8f8-44d1-9a90-b12fc1102974","Type":"ContainerStarted","Data":"a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564"} Jul 16 00:46:57.476273 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:57.476241 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:46:57.476505 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:57.476483 2557 patch_prober.go:28] interesting pod/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 16 00:46:57.476558 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:57.476537 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 16 00:46:58.476050 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:58.476017 2557 patch_prober.go:28] interesting pod/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 16 00:46:58.476438 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:58.476070 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 16 00:46:59.331745 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:59.331709 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:59.433203 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:59.433158 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:46:59.476277 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:59.476245 2557 patch_prober.go:28] interesting pod/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body= Jul 16 00:46:59.476624 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:46:59.476295 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" Jul 16 00:47:00.479434 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:00.479403 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:47:00.479895 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:00.479669 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:47:00.480412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:00.480396 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:47:03.801250 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:03.801219 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:06.983234 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:06.983205 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:07.081181 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:07.081149 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:22.317903 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:22.317868 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:30.682389 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:30.682357 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:44.251983 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:44.251926 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:44.526424 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:44.526344 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:47:44.537027 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:44.537000 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:47:45.320712 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:45.320673 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:45.748490 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:45.748447 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:47:50.827307 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:47:50.827268 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:29.523548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:29.523515 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:29.798932 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:29.798848 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c"] Jul 16 00:48:29.799157 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:29.799130 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" containerID="cri-o://a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564" gracePeriod=30 Jul 16 00:48:29.814642 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:29.814620 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:30.075777 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:30.075690 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:30.482540 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:30.482507 2557 patch_prober.go:28] interesting pod/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 16 00:48:30.482703 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:30.482563 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:48:30.548061 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:30.548025 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:32.635851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:32.635814 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:35.050616 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.050588 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:48:35.051569 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.051546 2557 generic.go:356] "Generic (PLEG): container finished" podID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerID="a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564" exitCode=0 Jul 16 00:48:35.051667 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.051617 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" event={"ID":"55c82220-b8f8-44d1-9a90-b12fc1102974","Type":"ContainerDied","Data":"a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564"} Jul 16 00:48:35.051667 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.051664 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" event={"ID":"55c82220-b8f8-44d1-9a90-b12fc1102974","Type":"ContainerDied","Data":"bac5af14a4612e6863316351cac3ec306df5876ee18633a65a3ee0050918aa4c"} Jul 16 00:48:35.051751 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.051687 2557 scope.go:117] "RemoveContainer" containerID="a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564" Jul 16 00:48:35.060339 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.060320 2557 scope.go:117] "RemoveContainer" containerID="bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e" Jul 16 00:48:35.068173 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.068127 2557 scope.go:117] "RemoveContainer" containerID="a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564" Jul 16 00:48:35.068474 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:48:35.068452 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564\": container with ID starting with a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564 not found: ID does not exist" containerID="a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564" Jul 16 00:48:35.068560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.068481 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564"} err="failed to get container status \"a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564\": rpc error: code = NotFound desc = could not find container \"a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564\": container with ID starting with a678dd2cd6d04bd7442785320e2913ae21eea1df16da2a22fb84a862e2611564 not found: ID does not exist" Jul 16 00:48:35.068560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.068499 2557 scope.go:117] "RemoveContainer" containerID="bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e" Jul 16 00:48:35.068721 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:48:35.068704 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e\": container with ID starting with bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e not found: ID does not exist" containerID="bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e" Jul 16 00:48:35.068765 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.068727 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e"} err="failed to get container status \"bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e\": rpc error: code = NotFound desc = could not find container \"bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e\": container with ID starting with bd9e782f37fc6812410a5e22633949891a271dbf458822138a1e1c517936749e not found: ID does not exist" Jul 16 00:48:35.146537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146500 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-podinfo\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146537 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146542 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-socket\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146790 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146570 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-token\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146790 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146616 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c82220-b8f8-44d1-9a90-b12fc1102974-istiod-ca-cert\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146790 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146652 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4c85\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-kube-api-access-s4c85\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146790 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146680 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-credential-socket\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146790 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146707 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-envoy\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146790 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146738 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-data\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.146790 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.146779 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-certs\") pod \"55c82220-b8f8-44d1-9a90-b12fc1102974\" (UID: \"55c82220-b8f8-44d1-9a90-b12fc1102974\") " Jul 16 00:48:35.147194 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.147010 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:48:35.147194 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.147091 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c82220-b8f8-44d1-9a90-b12fc1102974-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:48:35.147299 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.147193 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:48:35.147299 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.147219 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:48:35.147844 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.147813 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-data" (OuterVolumeSpecName: "istio-data") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:48:35.148776 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.148750 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:48:35.148881 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.148830 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-token" (OuterVolumeSpecName: "istio-token") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:48:35.149160 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.149131 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:48:35.149217 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.149161 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-kube-api-access-s4c85" (OuterVolumeSpecName: "kube-api-access-s4c85") pod "55c82220-b8f8-44d1-9a90-b12fc1102974" (UID: "55c82220-b8f8-44d1-9a90-b12fc1102974"). InnerVolumeSpecName "kube-api-access-s4c85". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:48:35.247414 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247380 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4c85\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-kube-api-access-s4c85\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247414 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247407 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247414 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247417 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247634 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247425 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247634 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247433 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247634 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247441 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247634 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247448 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55c82220-b8f8-44d1-9a90-b12fc1102974-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247634 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247456 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55c82220-b8f8-44d1-9a90-b12fc1102974-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:35.247634 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:35.247464 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55c82220-b8f8-44d1-9a90-b12fc1102974-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:48:36.058868 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:36.058798 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c" Jul 16 00:48:36.084909 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:36.084881 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c"] Jul 16 00:48:36.088518 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:36.088496 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a70600-openshift-default-788459cdf-q4v4c"] Jul 16 00:48:36.382940 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:36.382860 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" path="/var/lib/kubelet/pods/55c82220-b8f8-44d1-9a90-b12fc1102974/volumes" Jul 16 00:48:37.175159 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:37.175124 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:37.288196 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:37.288161 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:37.456224 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:37.456121 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:37.683636 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:37.683600 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:38.013811 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.013763 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:38.383929 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.383845 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz"] Jul 16 00:48:38.384281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.384201 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" Jul 16 00:48:38.384281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.384213 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" Jul 16 00:48:38.384356 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.384284 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" Jul 16 00:48:38.384356 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.384294 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" Jul 16 00:48:38.388572 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.388554 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.392839 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.392820 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-c6bb64-openshift-default-dockercfg-2sl8d\"" Jul 16 00:48:38.415851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.415816 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz"] Jul 16 00:48:38.437479 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.437446 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:38.482801 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.482765 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-socket\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.482801 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.482804 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-envoy\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.483092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.482823 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-data\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.483092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.482928 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-credential-socket\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.483092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.483018 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-kube-api-access-sbwxk\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.483092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.483054 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-podinfo\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.483092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.483088 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istiod-ca-cert\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.483342 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.483137 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-certs\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.483342 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.483206 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-token\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.583828 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.583795 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-certs\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.583898 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-token\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.583933 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-socket\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.583994 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-envoy\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584049 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584018 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-data\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584049 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-credential-socket\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584091 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-kube-api-access-sbwxk\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584127 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-podinfo\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584160 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istiod-ca-cert\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584550 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584328 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-certs\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584550 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584446 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-data\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584550 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584481 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-socket\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.584550 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584534 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-credential-socket\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.585023 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.584998 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istiod-ca-cert\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.586650 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.586628 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-envoy\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.586792 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.586777 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-podinfo\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.597617 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.597588 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-kube-api-access-sbwxk\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.597744 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.597700 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-token\") pod \"e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.655584 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.655482 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:38.698626 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.698592 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:38.838089 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.838063 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz"] Jul 16 00:48:38.840008 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:48:38.839983 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fdaefbb_2c9b_4177_854b_9f93ce225e3c.slice/crio-ba7f4f6441a5a73cf036c406497fcbae673abdc10fd8eb03fd3d365629eb1933 WatchSource:0}: Error finding container ba7f4f6441a5a73cf036c406497fcbae673abdc10fd8eb03fd3d365629eb1933: Status 404 returned error can't find the container with id ba7f4f6441a5a73cf036c406497fcbae673abdc10fd8eb03fd3d365629eb1933 Jul 16 00:48:38.842107 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.842078 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:38.842205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.842156 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:38.842270 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:38.842226 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:39.078226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:39.078190 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" event={"ID":"0fdaefbb-2c9b-4177-854b-9f93ce225e3c","Type":"ContainerStarted","Data":"c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282"} Jul 16 00:48:39.078435 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:39.078256 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" event={"ID":"0fdaefbb-2c9b-4177-854b-9f93ce225e3c","Type":"ContainerStarted","Data":"ba7f4f6441a5a73cf036c406497fcbae673abdc10fd8eb03fd3d365629eb1933"} Jul 16 00:48:39.104436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:39.104384 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podStartSLOduration=1.104365269 podStartE2EDuration="1.104365269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:39.10132596 +0000 UTC m=+2155.169189265" watchObservedRunningTime="2026-07-16 00:48:39.104365269 +0000 UTC m=+2155.172228555" Jul 16 00:48:39.699568 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:39.699527 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:39.704281 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:39.704258 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:40.084853 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.084825 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:40.085765 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.085749 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:40.216826 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.216799 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:40.304091 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.304053 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5"] Jul 16 00:48:40.304469 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.304455 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" Jul 16 00:48:40.304469 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.304471 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c82220-b8f8-44d1-9a90-b12fc1102974" containerName="istio-proxy" Jul 16 00:48:40.307527 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.307507 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.312949 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.312927 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c6bb64-serving-cert\"" Jul 16 00:48:40.342704 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.342627 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5"] Jul 16 00:48:40.402363 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.402332 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d37686-dfe1-4118-a289-de2b890202e2-maas-api-tls\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.402531 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.402384 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d37686-dfe1-4118-a289-de2b890202e2-openshift-service-ca\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.402531 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.402448 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnqsz\" (UniqueName: \"kubernetes.io/projected/54d37686-dfe1-4118-a289-de2b890202e2-kube-api-access-xnqsz\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.503531 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.503493 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d37686-dfe1-4118-a289-de2b890202e2-openshift-service-ca\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.503718 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.503571 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnqsz\" (UniqueName: \"kubernetes.io/projected/54d37686-dfe1-4118-a289-de2b890202e2-kube-api-access-xnqsz\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.503718 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.503608 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d37686-dfe1-4118-a289-de2b890202e2-maas-api-tls\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.504181 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.504162 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/54d37686-dfe1-4118-a289-de2b890202e2-openshift-service-ca\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.506052 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.506035 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/54d37686-dfe1-4118-a289-de2b890202e2-maas-api-tls\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.537545 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.537517 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnqsz\" (UniqueName: \"kubernetes.io/projected/54d37686-dfe1-4118-a289-de2b890202e2-kube-api-access-xnqsz\") pod \"maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5\" (UID: \"54d37686-dfe1-4118-a289-de2b890202e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.538293 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.538272 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:40.618441 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.618342 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:40.686988 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.686927 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:40.763441 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:40.763415 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5"] Jul 16 00:48:40.764943 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:48:40.764915 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54d37686_dfe1_4118_a289_de2b890202e2.slice/crio-10bc565405418d873e76405606ae10cb3fb057176514aad463331b1cb6b068a6 WatchSource:0}: Error finding container 10bc565405418d873e76405606ae10cb3fb057176514aad463331b1cb6b068a6: Status 404 returned error can't find the container with id 10bc565405418d873e76405606ae10cb3fb057176514aad463331b1cb6b068a6 Jul 16 00:48:41.091293 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:41.091261 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" event={"ID":"54d37686-dfe1-4118-a289-de2b890202e2","Type":"ContainerStarted","Data":"10bc565405418d873e76405606ae10cb3fb057176514aad463331b1cb6b068a6"} Jul 16 00:48:41.222677 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:41.222651 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:41.387362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:41.387258 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:42.098427 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:42.098372 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" event={"ID":"54d37686-dfe1-4118-a289-de2b890202e2","Type":"ContainerStarted","Data":"8fb8e0fd74315f3cb7ed01abfe5786470af2fdcaf5ce31126e6f06c749645d0d"} Jul 16 00:48:42.098941 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:42.098713 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:42.124059 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:42.124015 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" podStartSLOduration=1.671535126 podStartE2EDuration="2.124000168s" totalImagesPullingTime="452.465042ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:42.123591531 +0000 UTC m=+2158.191454821" watchObservedRunningTime="2026-07-16 00:48:42.124000168 +0000 UTC m=+2158.191863455" Jul 16 00:48:45.631997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:45.631943 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:46.145221 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.145188 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:46.430279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.430205 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c"] Jul 16 00:48:46.435116 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.435095 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.438056 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.438037 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-cc8d5c-openshift-default-dockercfg-hhv57\"" Jul 16 00:48:46.452149 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.452119 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c"] Jul 16 00:48:46.484310 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.484280 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:46.560198 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560165 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-envoy\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560198 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560200 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-podinfo\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560219 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b715a43f-3328-4391-b2a4-a3669a44ea06-istiod-ca-cert\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560244 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-credential-socket\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560322 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-socket\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560355 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-data\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560412 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560380 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lwl8\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-kube-api-access-9lwl8\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560568 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560476 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-certs\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.560568 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.560515 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-token\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.629098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.629037 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:46.661582 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.661551 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-envoy\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.661582 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.661583 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-podinfo\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.661600 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b715a43f-3328-4391-b2a4-a3669a44ea06-istiod-ca-cert\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.661724 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-credential-socket\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.661766 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-socket\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.661915 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-data\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.661995 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lwl8\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-kube-api-access-9lwl8\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.662067 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-socket\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.662085 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-certs\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.662142 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-token\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.662163 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-credential-socket\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.662272 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-data\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662519 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.662340 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b715a43f-3328-4391-b2a4-a3669a44ea06-istiod-ca-cert\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.662519 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.662494 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-certs\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.663973 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.663947 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-envoy\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.664226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.664208 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-podinfo\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.676031 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.675923 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-token\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.676243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.676223 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lwl8\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-kube-api-access-9lwl8\") pod \"e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.745366 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.745334 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:46.889105 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.889076 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c"] Jul 16 00:48:46.890345 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:48:46.890324 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb715a43f_3328_4391_b2a4_a3669a44ea06.slice/crio-9272b2b0ac5d48a49dca23861da4d96a22c31a0ff265b6538629e006a4a4f5dd WatchSource:0}: Error finding container 9272b2b0ac5d48a49dca23861da4d96a22c31a0ff265b6538629e006a4a4f5dd: Status 404 returned error can't find the container with id 9272b2b0ac5d48a49dca23861da4d96a22c31a0ff265b6538629e006a4a4f5dd Jul 16 00:48:46.892436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.892409 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:46.892504 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.892469 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:46.892504 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:46.892496 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:47.130640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:47.130543 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" event={"ID":"b715a43f-3328-4391-b2a4-a3669a44ea06","Type":"ContainerStarted","Data":"f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c"} Jul 16 00:48:47.130640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:47.130616 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" event={"ID":"b715a43f-3328-4391-b2a4-a3669a44ea06","Type":"ContainerStarted","Data":"9272b2b0ac5d48a49dca23861da4d96a22c31a0ff265b6538629e006a4a4f5dd"} Jul 16 00:48:47.745685 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:47.745650 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:47.751289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:47.751264 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:47.780768 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:47.780703 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" podStartSLOduration=1.780684704 podStartE2EDuration="1.780684704s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:47.157262941 +0000 UTC m=+2163.225126232" watchObservedRunningTime="2026-07-16 00:48:47.780684704 +0000 UTC m=+2163.848547991" Jul 16 00:48:48.106415 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.106334 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:48.108854 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.108834 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5" Jul 16 00:48:48.136779 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.136752 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:48.137619 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.137600 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:48:48.213121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.213086 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq"] Jul 16 00:48:48.217139 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.217117 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.230326 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.230299 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-cc8d5c-serving-cert\"" Jul 16 00:48:48.241017 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.240938 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq"] Jul 16 00:48:48.278682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.278630 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:48.378292 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.378181 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75a69fb9-f270-4d93-9235-362759a57ce7-maas-api-tls\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.378292 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.378228 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9p8m\" (UniqueName: \"kubernetes.io/projected/75a69fb9-f270-4d93-9235-362759a57ce7-kube-api-access-w9p8m\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.378525 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.378312 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a69fb9-f270-4d93-9235-362759a57ce7-openshift-service-ca\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.424243 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.424201 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:48.479984 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.479921 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75a69fb9-f270-4d93-9235-362759a57ce7-maas-api-tls\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.480164 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.479992 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9p8m\" (UniqueName: \"kubernetes.io/projected/75a69fb9-f270-4d93-9235-362759a57ce7-kube-api-access-w9p8m\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.480164 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.480031 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a69fb9-f270-4d93-9235-362759a57ce7-openshift-service-ca\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.480725 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.480705 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75a69fb9-f270-4d93-9235-362759a57ce7-openshift-service-ca\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.484092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.484059 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75a69fb9-f270-4d93-9235-362759a57ce7-maas-api-tls\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.497749 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.497705 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9p8m\" (UniqueName: \"kubernetes.io/projected/75a69fb9-f270-4d93-9235-362759a57ce7-kube-api-access-w9p8m\") pod \"maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq\" (UID: \"75a69fb9-f270-4d93-9235-362759a57ce7\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.527492 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.527455 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:48.528221 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.528188 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:48.712025 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:48.711995 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq"] Jul 16 00:48:48.713911 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:48:48.713884 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75a69fb9_f270_4d93_9235_362759a57ce7.slice/crio-831d2dba9022011fda2ebe3ea6d502681ca5c04e6782d79064bb86f868e4c724 WatchSource:0}: Error finding container 831d2dba9022011fda2ebe3ea6d502681ca5c04e6782d79064bb86f868e4c724: Status 404 returned error can't find the container with id 831d2dba9022011fda2ebe3ea6d502681ca5c04e6782d79064bb86f868e4c724 Jul 16 00:48:49.125715 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:49.125681 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:49.144397 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:49.144370 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" event={"ID":"75a69fb9-f270-4d93-9235-362759a57ce7","Type":"ContainerStarted","Data":"9810e48f55519e26e1f9af89b62c9818293f88e7f2b3cbab53c19b44a7ad8a9d"} Jul 16 00:48:49.144502 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:49.144422 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" event={"ID":"75a69fb9-f270-4d93-9235-362759a57ce7","Type":"ContainerStarted","Data":"831d2dba9022011fda2ebe3ea6d502681ca5c04e6782d79064bb86f868e4c724"} Jul 16 00:48:49.144502 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:49.144455 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:49.184989 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:49.181009 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" podStartSLOduration=0.845398311 podStartE2EDuration="1.18098987s" totalImagesPullingTime="335.591559ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:48:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:48:49.179376042 +0000 UTC m=+2165.247239330" watchObservedRunningTime="2026-07-16 00:48:49.18098987 +0000 UTC m=+2165.248853164" Jul 16 00:48:49.247073 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:49.247039 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:53.600685 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:53.600629 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:48:55.155858 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:55.155817 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq" Jul 16 00:48:55.854857 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:55.853563 2557 patch_prober.go:28] interesting pod/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:51176->10.132.0.56:15021: read: connection reset by peer" start-of-body= Jul 16 00:48:55.854857 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:55.853650 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": read tcp 10.132.0.2:51176->10.132.0.56:15021: read: connection reset by peer" Jul 16 00:48:56.188288 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:56.187031 2557 generic.go:356] "Generic (PLEG): container finished" podID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerID="c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282" exitCode=0 Jul 16 00:48:56.188288 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:56.187108 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" event={"ID":"0fdaefbb-2c9b-4177-854b-9f93ce225e3c","Type":"ContainerDied","Data":"c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282"} Jul 16 00:48:56.188288 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:56.187545 2557 scope.go:117] "RemoveContainer" containerID="c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282" Jul 16 00:48:56.190984 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:56.190181 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:56.190984 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:56.190275 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:56.190984 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:56.190321 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:48:57.198771 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:57.198727 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" event={"ID":"0fdaefbb-2c9b-4177-854b-9f93ce225e3c","Type":"ContainerStarted","Data":"3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446"} Jul 16 00:48:57.699656 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:57.699617 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:48:57.700299 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:57.700272 2557 patch_prober.go:28] interesting pod/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 00:48:57.700490 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:57.700466 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 00:48:58.700108 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:58.699605 2557 patch_prober.go:28] interesting pod/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 00:48:58.700108 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:58.699672 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 00:48:59.700538 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:59.700063 2557 patch_prober.go:28] interesting pod/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 00:48:59.700538 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:48:59.700142 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 00:49:00.699504 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:00.699457 2557 patch_prober.go:28] interesting pod/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 16 00:49:00.699710 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:00.699539 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 16 00:49:01.227330 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.227235 2557 generic.go:356] "Generic (PLEG): container finished" podID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerID="f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c" exitCode=0 Jul 16 00:49:01.227330 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.227312 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" event={"ID":"b715a43f-3328-4391-b2a4-a3669a44ea06","Type":"ContainerDied","Data":"f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c"} Jul 16 00:49:01.227905 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.227694 2557 scope.go:117] "RemoveContainer" containerID="f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c" Jul 16 00:49:01.228727 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.228674 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:01.228808 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.228736 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:01.228808 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.228765 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:01.704327 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.704290 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:49:01.704698 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.704677 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:49:01.708812 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:01.708787 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:49:02.141261 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:02.141230 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:02.235028 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:02.234992 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" event={"ID":"b715a43f-3328-4391-b2a4-a3669a44ea06","Type":"ContainerStarted","Data":"f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514"} Jul 16 00:49:02.387450 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:02.387392 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:02.566152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:02.566110 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:02.745829 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:02.745792 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:49:02.746899 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:02.746875 2557 patch_prober.go:28] interesting pod/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 16 00:49:02.747018 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:02.746938 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 16 00:49:03.137414 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:03.137379 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:49:03.746524 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:03.746488 2557 patch_prober.go:28] interesting pod/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 16 00:49:03.746929 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:03.746551 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 16 00:49:04.746304 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:04.746267 2557 patch_prober.go:28] interesting pod/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 16 00:49:04.746489 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:04.746334 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 16 00:49:05.746673 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:05.746636 2557 patch_prober.go:28] interesting pod/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 16 00:49:05.747121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:05.746697 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 16 00:49:06.749742 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:06.749714 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:49:06.750732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:06.750713 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:49:08.603182 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:08.603142 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:11.124004 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:11.123952 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:11.224398 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:11.224366 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:14.494213 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:14.494171 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:14.587056 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:14.587017 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:14.778387 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:14.778309 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz"] Jul 16 00:49:14.778580 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:14.778558 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" containerID="cri-o://3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446" gracePeriod=30 Jul 16 00:49:14.802468 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:14.802445 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:15.008935 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:15.008903 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:15.478564 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:15.478533 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:16.707488 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:16.707446 2557 patch_prober.go:28] interesting pod/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 16 00:49:16.707945 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:16.707518 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 16 00:49:20.035902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.035875 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:49:20.090130 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090052 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-certs\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090130 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090104 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-data\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090346 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090138 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-kube-api-access-sbwxk\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090346 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090196 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-token\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090346 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090251 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-socket\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090346 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090299 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-envoy\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090346 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090323 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istiod-ca-cert\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090604 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090319 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:20.090604 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090352 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-podinfo\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090604 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090411 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-credential-socket\") pod \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\" (UID: \"0fdaefbb-2c9b-4177-854b-9f93ce225e3c\") " Jul 16 00:49:20.090767 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090664 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:20.090767 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090709 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.090767 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090730 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:20.090943 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.090916 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:20.091056 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.091037 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-data" (OuterVolumeSpecName: "istio-data") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:20.092446 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.092424 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:49:20.092728 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.092707 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:20.092812 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.092779 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:20.092812 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.092794 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-kube-api-access-sbwxk" (OuterVolumeSpecName: "kube-api-access-sbwxk") pod "0fdaefbb-2c9b-4177-854b-9f93ce225e3c" (UID: "0fdaefbb-2c9b-4177-854b-9f93ce225e3c"). InnerVolumeSpecName "kube-api-access-sbwxk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:20.191799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191765 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.191799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191792 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.191799 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191803 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.192066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191811 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.192066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191819 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.192066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191826 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.192066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191842 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.192066 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.191853 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbwxk\" (UniqueName: \"kubernetes.io/projected/0fdaefbb-2c9b-4177-854b-9f93ce225e3c-kube-api-access-sbwxk\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:20.344696 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.344591 2557 generic.go:356] "Generic (PLEG): container finished" podID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerID="3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446" exitCode=0 Jul 16 00:49:20.344696 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.344648 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" Jul 16 00:49:20.344696 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.344682 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" event={"ID":"0fdaefbb-2c9b-4177-854b-9f93ce225e3c","Type":"ContainerDied","Data":"3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446"} Jul 16 00:49:20.344932 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.344777 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz" event={"ID":"0fdaefbb-2c9b-4177-854b-9f93ce225e3c","Type":"ContainerDied","Data":"ba7f4f6441a5a73cf036c406497fcbae673abdc10fd8eb03fd3d365629eb1933"} Jul 16 00:49:20.344932 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.344809 2557 scope.go:117] "RemoveContainer" containerID="3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446" Jul 16 00:49:20.354563 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.354545 2557 scope.go:117] "RemoveContainer" containerID="c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282" Jul 16 00:49:20.362540 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.362523 2557 scope.go:117] "RemoveContainer" containerID="3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446" Jul 16 00:49:20.362793 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:20.362775 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446\": container with ID starting with 3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446 not found: ID does not exist" containerID="3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446" Jul 16 00:49:20.362850 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.362803 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446"} err="failed to get container status \"3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446\": rpc error: code = NotFound desc = could not find container \"3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446\": container with ID starting with 3076d8e69c7d4a33a7c110e7cf94851cf5fee8decb4e42aaefb9102946c22446 not found: ID does not exist" Jul 16 00:49:20.362850 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.362820 2557 scope.go:117] "RemoveContainer" containerID="c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282" Jul 16 00:49:20.363084 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:20.363068 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282\": container with ID starting with c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282 not found: ID does not exist" containerID="c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282" Jul 16 00:49:20.363132 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.363089 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282"} err="failed to get container status \"c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282\": rpc error: code = NotFound desc = could not find container \"c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282\": container with ID starting with c269406716a524d6b50678597a594d093567511c1b57c2944b4d88c28c97c282 not found: ID does not exist" Jul 16 00:49:20.370440 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.370414 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz"] Jul 16 00:49:20.375975 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.375934 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-c6bb64-openshift-default-57d7cf4dfc-kxqzz"] Jul 16 00:49:20.381957 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:20.381936 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" path="/var/lib/kubelet/pods/0fdaefbb-2c9b-4177-854b-9f93ce225e3c/volumes" Jul 16 00:49:21.842900 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:21.842864 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:28.256232 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:28.256196 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:28.499667 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:28.499634 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:28.553892 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:28.553801 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c"] Jul 16 00:49:28.554073 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:28.554028 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" containerID="cri-o://f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514" gracePeriod=30 Jul 16 00:49:28.610405 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:28.610372 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:28.761102 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:28.761059 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:29.100119 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:29.100083 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:29.444348 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:29.444268 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:29.604365 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:29.604331 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:31.975198 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:31.975163 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:32.056318 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.056281 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h"] Jul 16 00:49:32.056741 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.056728 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" Jul 16 00:49:32.056787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.056745 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" Jul 16 00:49:32.056787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.056762 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" Jul 16 00:49:32.056787 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.056768 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" Jul 16 00:49:32.056881 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.056840 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" Jul 16 00:49:32.056881 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.056850 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fdaefbb-2c9b-4177-854b-9f93ce225e3c" containerName="istio-proxy" Jul 16 00:49:32.061287 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.061270 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.076088 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.068758 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-7ee350-serving-cert\"" Jul 16 00:49:32.082827 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.082803 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h"] Jul 16 00:49:32.131301 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.131273 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:32.204428 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.204394 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f97413-535a-42ea-9a00-fca64b608fbe-maas-api-tls\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.204428 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.204428 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f97413-535a-42ea-9a00-fca64b608fbe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.204646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.204452 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8v6v\" (UniqueName: \"kubernetes.io/projected/e1f97413-535a-42ea-9a00-fca64b608fbe-kube-api-access-q8v6v\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.286309 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.286272 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:32.305541 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.305513 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f97413-535a-42ea-9a00-fca64b608fbe-maas-api-tls\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.305661 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.305553 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f97413-535a-42ea-9a00-fca64b608fbe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.305661 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.305583 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8v6v\" (UniqueName: \"kubernetes.io/projected/e1f97413-535a-42ea-9a00-fca64b608fbe-kube-api-access-q8v6v\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.305758 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:32.305656 2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-serving-cert: secret "maas-api-e2e-shared-a-7ee350-serving-cert" not found Jul 16 00:49:32.305758 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:32.305722 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e1f97413-535a-42ea-9a00-fca64b608fbe-maas-api-tls podName:e1f97413-535a-42ea-9a00-fca64b608fbe nodeName:}" failed. No retries permitted until 2026-07-16 00:49:32.805706412 +0000 UTC m=+2208.873569679 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e1f97413-535a-42ea-9a00-fca64b608fbe-maas-api-tls") pod "maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" (UID: "e1f97413-535a-42ea-9a00-fca64b608fbe") : secret "maas-api-e2e-shared-a-7ee350-serving-cert" not found Jul 16 00:49:32.306293 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.306272 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1f97413-535a-42ea-9a00-fca64b608fbe-openshift-service-ca\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.323693 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.323667 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8v6v\" (UniqueName: \"kubernetes.io/projected/e1f97413-535a-42ea-9a00-fca64b608fbe-kube-api-access-q8v6v\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.748985 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.748927 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:32.811368 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.811335 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f97413-535a-42ea-9a00-fca64b608fbe-maas-api-tls\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.813913 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.813882 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1f97413-535a-42ea-9a00-fca64b608fbe-maas-api-tls\") pod \"maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h\" (UID: \"e1f97413-535a-42ea-9a00-fca64b608fbe\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:32.977589 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:32.977558 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:33.153569 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.153538 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h"] Jul 16 00:49:33.155134 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:49:33.155104 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1f97413_535a_42ea_9a00_fca64b608fbe.slice/crio-a697b7eb31910859aa243b388f14e6f0b6cc1939297ed82ac8e4ac70d93dcaee WatchSource:0}: Error finding container a697b7eb31910859aa243b388f14e6f0b6cc1939297ed82ac8e4ac70d93dcaee: Status 404 returned error can't find the container with id a697b7eb31910859aa243b388f14e6f0b6cc1939297ed82ac8e4ac70d93dcaee Jul 16 00:49:33.159803 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.159679 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:33.352550 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.352420 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:33.423666 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.423635 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" event={"ID":"e1f97413-535a-42ea-9a00-fca64b608fbe","Type":"ContainerStarted","Data":"a697b7eb31910859aa243b388f14e6f0b6cc1939297ed82ac8e4ac70d93dcaee"} Jul 16 00:49:33.807461 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.807434 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:49:33.922257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922158 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-token\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922213 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-socket\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922257 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922252 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-podinfo\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922551 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922267 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lwl8\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-kube-api-access-9lwl8\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922551 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922292 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-credential-socket\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922551 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922317 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-envoy\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922551 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922353 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b715a43f-3328-4391-b2a4-a3669a44ea06-istiod-ca-cert\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922551 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922391 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-data\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922551 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922416 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-certs\") pod \"b715a43f-3328-4391-b2a4-a3669a44ea06\" (UID: \"b715a43f-3328-4391-b2a4-a3669a44ea06\") " Jul 16 00:49:33.922865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922586 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:33.922865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922620 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:33.922865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922775 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:33.922865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922789 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:33.922865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922794 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:33.923170 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.922870 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b715a43f-3328-4391-b2a4-a3669a44ea06-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:49:33.923457 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.923434 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-data" (OuterVolumeSpecName: "istio-data") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:33.924524 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.924500 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:49:33.924633 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.924609 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-kube-api-access-9lwl8" (OuterVolumeSpecName: "kube-api-access-9lwl8") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "kube-api-access-9lwl8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:33.924800 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.924772 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:49:33.924912 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:33.924866 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-token" (OuterVolumeSpecName: "istio-token") pod "b715a43f-3328-4391-b2a4-a3669a44ea06" (UID: "b715a43f-3328-4391-b2a4-a3669a44ea06"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:49:34.024371 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.024334 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:34.024371 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.024365 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lwl8\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-kube-api-access-9lwl8\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:34.024371 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.024375 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:34.024371 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.024384 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b715a43f-3328-4391-b2a4-a3669a44ea06-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:34.024840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.024392 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:34.024840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.024400 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b715a43f-3328-4391-b2a4-a3669a44ea06-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:34.024840 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.024407 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b715a43f-3328-4391-b2a4-a3669a44ea06-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:49:34.430900 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.430861 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" event={"ID":"e1f97413-535a-42ea-9a00-fca64b608fbe","Type":"ContainerStarted","Data":"582ac88c76d36921c450e54d143afe4e13af1439e03655b792aca0bfe7e6ea58"} Jul 16 00:49:34.431113 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.431089 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:34.432874 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.432845 2557 generic.go:356] "Generic (PLEG): container finished" podID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerID="f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514" exitCode=0 Jul 16 00:49:34.433054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.432884 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" event={"ID":"b715a43f-3328-4391-b2a4-a3669a44ea06","Type":"ContainerDied","Data":"f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514"} Jul 16 00:49:34.433054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.432890 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" Jul 16 00:49:34.433054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.432938 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c" event={"ID":"b715a43f-3328-4391-b2a4-a3669a44ea06","Type":"ContainerDied","Data":"9272b2b0ac5d48a49dca23861da4d96a22c31a0ff265b6538629e006a4a4f5dd"} Jul 16 00:49:34.433054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.432986 2557 scope.go:117] "RemoveContainer" containerID="f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514" Jul 16 00:49:34.442268 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.442251 2557 scope.go:117] "RemoveContainer" containerID="f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c" Jul 16 00:49:34.450458 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.450439 2557 scope.go:117] "RemoveContainer" containerID="f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514" Jul 16 00:49:34.450730 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:34.450711 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514\": container with ID starting with f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514 not found: ID does not exist" containerID="f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514" Jul 16 00:49:34.450772 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.450740 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514"} err="failed to get container status \"f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514\": rpc error: code = NotFound desc = could not find container \"f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514\": container with ID starting with f0112525ac291a60c25660ab7bb3aed396c7997944ef38fda08e9f1a3eef4514 not found: ID does not exist" Jul 16 00:49:34.450772 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.450762 2557 scope.go:117] "RemoveContainer" containerID="f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c" Jul 16 00:49:34.451036 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:34.451017 2557 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c\": container with ID starting with f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c not found: ID does not exist" containerID="f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c" Jul 16 00:49:34.451104 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.451042 2557 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c"} err="failed to get container status \"f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c\": rpc error: code = NotFound desc = could not find container \"f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c\": container with ID starting with f90edd1716009e1406ae893573c5db968d67f2b4832422831102c15590f7663c not found: ID does not exist" Jul 16 00:49:34.455889 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.455829 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" podStartSLOduration=2.127990769 podStartE2EDuration="2.455816216s" totalImagesPullingTime="327.825447ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:34.452626979 +0000 UTC m=+2210.520490266" watchObservedRunningTime="2026-07-16 00:49:34.455816216 +0000 UTC m=+2210.523679535" Jul 16 00:49:34.474361 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.474334 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c"] Jul 16 00:49:34.476614 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:34.476595 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-cc8d5c-openshift-default-658f5f6f6f-rz98c"] Jul 16 00:49:36.383141 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:36.383108 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" path="/var/lib/kubelet/pods/b715a43f-3328-4391-b2a4-a3669a44ea06/volumes" Jul 16 00:49:37.477661 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:37.477618 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:37.831518 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:37.831486 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:38.163727 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.163645 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8"] Jul 16 00:49:38.164132 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.164119 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" Jul 16 00:49:38.164185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.164134 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" Jul 16 00:49:38.164185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.164150 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" Jul 16 00:49:38.164185 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.164156 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" Jul 16 00:49:38.164279 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.164227 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" Jul 16 00:49:38.168682 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.168664 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.175936 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.175918 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-07a8dc-openshift-default-dockercfg-6mgpk\"" Jul 16 00:49:38.267621 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267594 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-podinfo\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.267778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267634 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-socket\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.267778 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267672 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz2ph\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-kube-api-access-jz2ph\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.267869 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267774 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-credential-socket\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.267869 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267801 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-envoy\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.267869 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267817 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-data\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.267869 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267832 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-token\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.268050 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267907 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istiod-ca-cert\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.268050 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.267976 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-certs\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.284596 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.284569 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8"] Jul 16 00:49:38.317260 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.317228 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:38.368804 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.368772 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-credential-socket\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.368997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.368814 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-envoy\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.368997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.368837 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-data\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.368997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.368858 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-token\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.368997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.368887 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istiod-ca-cert\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.368997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.368917 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-certs\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.368997 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.368941 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-podinfo\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.369327 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.369025 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-socket\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.369327 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.369079 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jz2ph\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-kube-api-access-jz2ph\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.369327 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.369252 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-credential-socket\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.369327 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.369277 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-data\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.369502 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.369359 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-certs\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.369556 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.369517 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-socket\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.369666 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.369637 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istiod-ca-cert\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.371122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.371095 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-envoy\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.371496 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.371480 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-podinfo\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.384978 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.384941 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz2ph\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-kube-api-access-jz2ph\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.386589 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.386571 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-token\") pod \"e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.455002 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.454903 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:38.478565 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.478533 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:38.648229 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.648201 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8"] Jul 16 00:49:38.650076 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:49:38.650051 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c49077_76f7_4e2a_8f0c_a9eb8d26c5ee.slice/crio-c332cdfa7a69e54adc8f7b80d9f23b5537f8cff3283669082ff54d4c12f6b526 WatchSource:0}: Error finding container c332cdfa7a69e54adc8f7b80d9f23b5537f8cff3283669082ff54d4c12f6b526: Status 404 returned error can't find the container with id c332cdfa7a69e54adc8f7b80d9f23b5537f8cff3283669082ff54d4c12f6b526 Jul 16 00:49:38.652087 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.652057 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:38.652176 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.652142 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:38.652176 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:38.652171 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:39.464160 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:39.464123 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" event={"ID":"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee","Type":"ContainerStarted","Data":"9ea323ffe617bfd76c681dc5e2da2bf13b47403935b729cba08a4a8c0f8246d8"} Jul 16 00:49:39.464334 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:39.464174 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" event={"ID":"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee","Type":"ContainerStarted","Data":"c332cdfa7a69e54adc8f7b80d9f23b5537f8cff3283669082ff54d4c12f6b526"} Jul 16 00:49:39.478924 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:39.478898 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:39.483768 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:39.483746 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:39.490836 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:39.490790 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" podStartSLOduration=1.49077731 podStartE2EDuration="1.49077731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:39.489185788 +0000 UTC m=+2215.557049076" watchObservedRunningTime="2026-07-16 00:49:39.49077731 +0000 UTC m=+2215.558640597" Jul 16 00:49:40.446017 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.445981 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h" Jul 16 00:49:40.469806 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.469780 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:40.470633 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.470613 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:40.510246 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.510218 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:40.620153 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.620121 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv"] Jul 16 00:49:40.620788 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.620773 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b715a43f-3328-4391-b2a4-a3669a44ea06" containerName="istio-proxy" Jul 16 00:49:40.624569 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.624551 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.627568 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.627547 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-07a8dc-serving-cert\"" Jul 16 00:49:40.643232 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.643212 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv"] Jul 16 00:49:40.658683 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.658657 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:40.754309 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.754276 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:40.793330 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.793304 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.793492 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.793356 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.793492 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.793391 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8h9t9\" (UniqueName: \"kubernetes.io/projected/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-kube-api-access-8h9t9\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.894129 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.894093 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.894129 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.894130 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8h9t9\" (UniqueName: \"kubernetes.io/projected/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-kube-api-access-8h9t9\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.894321 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.894219 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.894377 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:40.894364 2557 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-serving-cert: secret "maas-api-e2e-shared-b-07a8dc-serving-cert" not found Jul 16 00:49:40.894440 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:49:40.894431 2557 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-maas-api-tls podName:ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c nodeName:}" failed. No retries permitted until 2026-07-16 00:49:41.394411802 +0000 UTC m=+2217.462275075 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-maas-api-tls") pod "maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" (UID: "ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c") : secret "maas-api-e2e-shared-b-07a8dc-serving-cert" not found Jul 16 00:49:40.894748 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.894724 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-openshift-service-ca\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:40.916584 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:40.916556 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8h9t9\" (UniqueName: \"kubernetes.io/projected/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-kube-api-access-8h9t9\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:41.007592 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:41.007510 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:41.399490 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:41.399396 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:41.400121 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:41.400089 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:41.401973 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:41.401930 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c-maas-api-tls\") pod \"maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv\" (UID: \"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:41.501276 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:41.501232 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:41.535120 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:41.535085 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:41.681855 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:41.681825 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv"] Jul 16 00:49:41.683258 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:49:41.683234 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba7e9e2e_8acf_4bf1_8f39_99f2e228ba4c.slice/crio-306973e888719a28c24877959e2ffbd96af76208940d90e033995ca3afdfbfa2 WatchSource:0}: Error finding container 306973e888719a28c24877959e2ffbd96af76208940d90e033995ca3afdfbfa2: Status 404 returned error can't find the container with id 306973e888719a28c24877959e2ffbd96af76208940d90e033995ca3afdfbfa2 Jul 16 00:49:42.483729 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:42.483693 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" event={"ID":"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c","Type":"ContainerStarted","Data":"eb3ec3ed6567de87af4d514ecc1125f2e239121768f4b0c6775aa8842b337438"} Jul 16 00:49:42.483899 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:42.483754 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" event={"ID":"ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c","Type":"ContainerStarted","Data":"306973e888719a28c24877959e2ffbd96af76208940d90e033995ca3afdfbfa2"} Jul 16 00:49:42.483899 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:42.483787 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:42.511131 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:42.511085 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" podStartSLOduration=2.214125213 podStartE2EDuration="2.51107102s" totalImagesPullingTime="296.945807ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:49:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:49:42.508359488 +0000 UTC m=+2218.576222777" watchObservedRunningTime="2026-07-16 00:49:42.51107102 +0000 UTC m=+2218.578934304" Jul 16 00:49:46.051208 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:46.051173 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:48.495349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:48.495321 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv" Jul 16 00:49:54.267245 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:54.267202 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:54.367706 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:54.367676 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:55.690399 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:55.689125 2557 patch_prober.go:28] interesting pod/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": read tcp 10.132.0.2:42596->10.132.0.61:15021: read: connection reset by peer" start-of-body= Jul 16 00:49:55.690399 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:55.689190 2557 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": read tcp 10.132.0.2:42596->10.132.0.61:15021: read: connection reset by peer" Jul 16 00:49:56.317087 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.317046 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:56.490865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.490836 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:49:56.569302 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.569215 2557 generic.go:356] "Generic (PLEG): container finished" podID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerID="9ea323ffe617bfd76c681dc5e2da2bf13b47403935b729cba08a4a8c0f8246d8" exitCode=0 Jul 16 00:49:56.569302 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.569286 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" event={"ID":"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee","Type":"ContainerDied","Data":"9ea323ffe617bfd76c681dc5e2da2bf13b47403935b729cba08a4a8c0f8246d8"} Jul 16 00:49:56.569700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.569687 2557 scope.go:117] "RemoveContainer" containerID="9ea323ffe617bfd76c681dc5e2da2bf13b47403935b729cba08a4a8c0f8246d8" Jul 16 00:49:56.570675 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.570651 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:56.570728 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.570719 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:56.570765 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:56.570752 2557 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 16 00:49:57.576929 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:57.576892 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" event={"ID":"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee","Type":"ContainerStarted","Data":"c6064c127683037c06eaa09806dd8076ba2042614489da1aa45654d524e7a6da"} Jul 16 00:49:58.478956 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:58.478915 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:49:58.479215 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:58.479187 2557 patch_prober.go:28] interesting pod/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 16 00:49:58.479295 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:58.479250 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 16 00:49:59.479440 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:59.479402 2557 patch_prober.go:28] interesting pod/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 16 00:49:59.479950 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:49:59.479471 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 16 00:50:00.241285 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:00.241248 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:00.479289 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:00.479256 2557 patch_prober.go:28] interesting pod/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body= Jul 16 00:50:00.479476 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:00.479321 2557 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" Jul 16 00:50:01.482871 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:01.482840 2557 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:50:01.483366 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:01.483280 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:50:01.484048 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:01.484025 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:50:02.300336 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:02.300286 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:02.400725 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:02.400689 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:05.986600 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:05.986511 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:29.405800 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:29.405768 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:31.682924 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:31.682893 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:38.836100 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:38.836061 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:50:38.951076 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:50:38.951025 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:51:44.627699 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:51:44.627605 2557 scope.go:117] "RemoveContainer" containerID="16d82486ab4e6a04814701001fc4b1e22916fb3cf713bcf9ccf7bc750275c3c4" Jul 16 00:52:44.564556 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:52:44.564530 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:52:44.575556 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:52:44.575538 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:52:47.792351 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:52:47.792311 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:49.272990 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:52:49.272936 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:52:56.067680 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:52:56.067641 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:14.176879 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:53:14.176849 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:54.467159 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:53:54.467102 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:53:55.350310 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:53:55.350256 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:02.780604 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:54:02.780557 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:35.111523 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:54:35.111485 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:55.183869 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:54:55.183827 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:54:55.285054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:54:55.285019 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:03.095809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:03.095761 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:03.197158 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:03.197121 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:21.040367 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:21.040334 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:21.979141 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:21.979111 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:22.896456 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:22.896425 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-140009910602032"] Jul 16 00:55:22.899957 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:22.899940 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910602032" Jul 16 00:55:22.903011 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:22.902982 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-x5rsl\"" Jul 16 00:55:22.906133 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:22.906109 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009910602032"] Jul 16 00:55:22.919918 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:22.919887 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8z72z\" (UniqueName: \"kubernetes.io/projected/83ae428d-77ca-4f88-893b-0bfbc46a9c90-kube-api-access-8z72z\") pod \"test-curl-7552-140009910602032\" (UID: \"83ae428d-77ca-4f88-893b-0bfbc46a9c90\") " pod="opendatahub/test-curl-7552-140009910602032" Jul 16 00:55:23.020927 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:23.020888 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8z72z\" (UniqueName: \"kubernetes.io/projected/83ae428d-77ca-4f88-893b-0bfbc46a9c90-kube-api-access-8z72z\") pod \"test-curl-7552-140009910602032\" (UID: \"83ae428d-77ca-4f88-893b-0bfbc46a9c90\") " pod="opendatahub/test-curl-7552-140009910602032" Jul 16 00:55:23.029892 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:23.029868 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8z72z\" (UniqueName: \"kubernetes.io/projected/83ae428d-77ca-4f88-893b-0bfbc46a9c90-kube-api-access-8z72z\") pod \"test-curl-7552-140009910602032\" (UID: \"83ae428d-77ca-4f88-893b-0bfbc46a9c90\") " pod="opendatahub/test-curl-7552-140009910602032" Jul 16 00:55:23.210369 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:23.210312 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910602032" Jul 16 00:55:23.338723 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:55:23.338688 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83ae428d_77ca_4f88_893b_0bfbc46a9c90.slice/crio-b0914c52545ed42d1826232a7e4daf1a00d6adb379946b64ed9f07ccd6915965 WatchSource:0}: Error finding container b0914c52545ed42d1826232a7e4daf1a00d6adb379946b64ed9f07ccd6915965: Status 404 returned error can't find the container with id b0914c52545ed42d1826232a7e4daf1a00d6adb379946b64ed9f07ccd6915965 Jul 16 00:55:23.339120 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:23.339095 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009910602032"] Jul 16 00:55:23.340364 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:23.340349 2557 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 16 00:55:23.445505 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:23.445475 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009910602032" event={"ID":"83ae428d-77ca-4f88-893b-0bfbc46a9c90","Type":"ContainerStarted","Data":"b0914c52545ed42d1826232a7e4daf1a00d6adb379946b64ed9f07ccd6915965"} Jul 16 00:55:24.452398 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:24.452316 2557 generic.go:356] "Generic (PLEG): container finished" podID="83ae428d-77ca-4f88-893b-0bfbc46a9c90" containerID="1265ebd646950d2be945a883556735d4348e234991e291c405df2183b841f549" exitCode=0 Jul 16 00:55:24.452398 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:24.452383 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009910602032" event={"ID":"83ae428d-77ca-4f88-893b-0bfbc46a9c90","Type":"ContainerDied","Data":"1265ebd646950d2be945a883556735d4348e234991e291c405df2183b841f549"} Jul 16 00:55:25.587547 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.587525 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910602032" Jul 16 00:55:25.607542 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.607517 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-140009910602032_83ae428d-77ca-4f88-893b-0bfbc46a9c90/test-curl-7552-140009910602032/0.log" Jul 16 00:55:25.632835 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.632811 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-140009910602032"] Jul 16 00:55:25.636608 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.636587 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-140009910602032"] Jul 16 00:55:25.642567 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.642551 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8z72z\" (UniqueName: \"kubernetes.io/projected/83ae428d-77ca-4f88-893b-0bfbc46a9c90-kube-api-access-8z72z\") pod \"83ae428d-77ca-4f88-893b-0bfbc46a9c90\" (UID: \"83ae428d-77ca-4f88-893b-0bfbc46a9c90\") " Jul 16 00:55:25.644527 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.644503 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83ae428d-77ca-4f88-893b-0bfbc46a9c90-kube-api-access-8z72z" (OuterVolumeSpecName: "kube-api-access-8z72z") pod "83ae428d-77ca-4f88-893b-0bfbc46a9c90" (UID: "83ae428d-77ca-4f88-893b-0bfbc46a9c90"). InnerVolumeSpecName "kube-api-access-8z72z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:25.743260 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.743239 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8z72z\" (UniqueName: \"kubernetes.io/projected/83ae428d-77ca-4f88-893b-0bfbc46a9c90-kube-api-access-8z72z\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:55:25.756987 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.756942 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-140009910636720"] Jul 16 00:55:25.757382 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.757368 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83ae428d-77ca-4f88-893b-0bfbc46a9c90" containerName="test-curl-7552-140009910602032" Jul 16 00:55:25.757422 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.757385 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="83ae428d-77ca-4f88-893b-0bfbc46a9c90" containerName="test-curl-7552-140009910602032" Jul 16 00:55:25.757466 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.757457 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="83ae428d-77ca-4f88-893b-0bfbc46a9c90" containerName="test-curl-7552-140009910602032" Jul 16 00:55:25.760580 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.760566 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:25.764695 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.764675 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009910636720"] Jul 16 00:55:25.843710 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.843688 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqvjm\" (UniqueName: \"kubernetes.io/projected/9b110102-5d2b-4eda-96cb-25677bc02e96-kube-api-access-wqvjm\") pod \"test-curl-7552-140009910636720\" (UID: \"9b110102-5d2b-4eda-96cb-25677bc02e96\") " pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:25.944142 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.944120 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqvjm\" (UniqueName: \"kubernetes.io/projected/9b110102-5d2b-4eda-96cb-25677bc02e96-kube-api-access-wqvjm\") pod \"test-curl-7552-140009910636720\" (UID: \"9b110102-5d2b-4eda-96cb-25677bc02e96\") " pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:25.953136 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:25.953112 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqvjm\" (UniqueName: \"kubernetes.io/projected/9b110102-5d2b-4eda-96cb-25677bc02e96-kube-api-access-wqvjm\") pod \"test-curl-7552-140009910636720\" (UID: \"9b110102-5d2b-4eda-96cb-25677bc02e96\") " pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:26.069911 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:26.069858 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:26.199155 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:26.199131 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009910636720"] Jul 16 00:55:26.201125 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:55:26.201100 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9b110102_5d2b_4eda_96cb_25677bc02e96.slice/crio-767af53fae94f540b436045ac6b0e98bc86ae92820704de995e7e6312891d43b WatchSource:0}: Error finding container 767af53fae94f540b436045ac6b0e98bc86ae92820704de995e7e6312891d43b: Status 404 returned error can't find the container with id 767af53fae94f540b436045ac6b0e98bc86ae92820704de995e7e6312891d43b Jul 16 00:55:26.383714 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:26.383657 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="83ae428d-77ca-4f88-893b-0bfbc46a9c90" path="/var/lib/kubelet/pods/83ae428d-77ca-4f88-893b-0bfbc46a9c90/volumes" Jul 16 00:55:26.465130 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:26.465103 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009910636720" event={"ID":"9b110102-5d2b-4eda-96cb-25677bc02e96","Type":"ContainerStarted","Data":"767af53fae94f540b436045ac6b0e98bc86ae92820704de995e7e6312891d43b"} Jul 16 00:55:26.466231 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:26.466215 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910602032" Jul 16 00:55:26.466330 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:26.466247 2557 scope.go:117] "RemoveContainer" containerID="1265ebd646950d2be945a883556735d4348e234991e291c405df2183b841f549" Jul 16 00:55:27.472720 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:27.472671 2557 generic.go:356] "Generic (PLEG): container finished" podID="9b110102-5d2b-4eda-96cb-25677bc02e96" containerID="ac16f6cbbdf6433615f8fcc4c8a410bfed3cab273abe3f638b70237d664ac9cf" exitCode=0 Jul 16 00:55:27.473132 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:27.472761 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009910636720" event={"ID":"9b110102-5d2b-4eda-96cb-25677bc02e96","Type":"ContainerDied","Data":"ac16f6cbbdf6433615f8fcc4c8a410bfed3cab273abe3f638b70237d664ac9cf"} Jul 16 00:55:28.614875 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.614849 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:28.635559 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.635538 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-140009910636720_9b110102-5d2b-4eda-96cb-25677bc02e96/test-curl-7552-140009910636720/0.log" Jul 16 00:55:28.660609 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.660582 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-140009910636720"] Jul 16 00:55:28.664000 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.663981 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-140009910636720"] Jul 16 00:55:28.666936 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.666917 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqvjm\" (UniqueName: \"kubernetes.io/projected/9b110102-5d2b-4eda-96cb-25677bc02e96-kube-api-access-wqvjm\") pod \"9b110102-5d2b-4eda-96cb-25677bc02e96\" (UID: \"9b110102-5d2b-4eda-96cb-25677bc02e96\") " Jul 16 00:55:28.668795 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.668775 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b110102-5d2b-4eda-96cb-25677bc02e96-kube-api-access-wqvjm" (OuterVolumeSpecName: "kube-api-access-wqvjm") pod "9b110102-5d2b-4eda-96cb-25677bc02e96" (UID: "9b110102-5d2b-4eda-96cb-25677bc02e96"). InnerVolumeSpecName "kube-api-access-wqvjm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:28.767548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.767487 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqvjm\" (UniqueName: \"kubernetes.io/projected/9b110102-5d2b-4eda-96cb-25677bc02e96-kube-api-access-wqvjm\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:55:28.818923 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.818899 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:28.819331 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.819316 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b110102-5d2b-4eda-96cb-25677bc02e96" containerName="test-curl-7552-140009910636720" Jul 16 00:55:28.819385 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.819333 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b110102-5d2b-4eda-96cb-25677bc02e96" containerName="test-curl-7552-140009910636720" Jul 16 00:55:28.819423 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.819419 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b110102-5d2b-4eda-96cb-25677bc02e96" containerName="test-curl-7552-140009910636720" Jul 16 00:55:28.822538 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.822524 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:28.825851 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.825831 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:28.868581 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.868554 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k98cq\" (UniqueName: \"kubernetes.io/projected/018e4eef-de5a-47f4-8beb-b8620da26331-kube-api-access-k98cq\") pod \"test-curl-7552-140009912663328\" (UID: \"018e4eef-de5a-47f4-8beb-b8620da26331\") " pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:28.969423 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.969400 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k98cq\" (UniqueName: \"kubernetes.io/projected/018e4eef-de5a-47f4-8beb-b8620da26331-kube-api-access-k98cq\") pod \"test-curl-7552-140009912663328\" (UID: \"018e4eef-de5a-47f4-8beb-b8620da26331\") " pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:28.977929 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:28.977904 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k98cq\" (UniqueName: \"kubernetes.io/projected/018e4eef-de5a-47f4-8beb-b8620da26331-kube-api-access-k98cq\") pod \"test-curl-7552-140009912663328\" (UID: \"018e4eef-de5a-47f4-8beb-b8620da26331\") " pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:29.132146 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:29.132089 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:29.260469 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:29.260439 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:29.261768 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:55:29.261739 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod018e4eef_de5a_47f4_8beb_b8620da26331.slice/crio-f83e350a18b6f443955566300f6dbc7b57c1693f4881852f8eb8925a2d458a7e WatchSource:0}: Error finding container f83e350a18b6f443955566300f6dbc7b57c1693f4881852f8eb8925a2d458a7e: Status 404 returned error can't find the container with id f83e350a18b6f443955566300f6dbc7b57c1693f4881852f8eb8925a2d458a7e Jul 16 00:55:29.486527 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:29.486503 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:29.486673 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:29.486546 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="767af53fae94f540b436045ac6b0e98bc86ae92820704de995e7e6312891d43b" Jul 16 00:55:29.487702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:29.487682 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912663328" event={"ID":"018e4eef-de5a-47f4-8beb-b8620da26331","Type":"ContainerStarted","Data":"f83e350a18b6f443955566300f6dbc7b57c1693f4881852f8eb8925a2d458a7e"} Jul 16 00:55:29.496863 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:55:29.496840 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-140009910636720\" is forbidden: User \"system:node:ip-10-0-131-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-255.ec2.internal' and this object" podUID="9b110102-5d2b-4eda-96cb-25677bc02e96" pod="opendatahub/test-curl-7552-140009910636720" Jul 16 00:55:30.382310 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:30.382271 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b110102-5d2b-4eda-96cb-25677bc02e96" path="/var/lib/kubelet/pods/9b110102-5d2b-4eda-96cb-25677bc02e96/volumes" Jul 16 00:55:30.494569 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:30.494540 2557 generic.go:356] "Generic (PLEG): container finished" podID="018e4eef-de5a-47f4-8beb-b8620da26331" containerID="883b63e113107875a1fb19df198af7da13c9af761e3117d6bc33968fababc0b1" exitCode=0 Jul 16 00:55:30.494721 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:30.494635 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912663328" event={"ID":"018e4eef-de5a-47f4-8beb-b8620da26331","Type":"ContainerDied","Data":"883b63e113107875a1fb19df198af7da13c9af761e3117d6bc33968fababc0b1"} Jul 16 00:55:31.635835 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.635812 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:31.659995 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.659956 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-140009912663328_018e4eef-de5a-47f4-8beb-b8620da26331/test-curl-7552-140009912663328/0.log" Jul 16 00:55:31.686668 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.686642 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:31.688753 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.688735 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:31.691943 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.691924 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k98cq\" (UniqueName: \"kubernetes.io/projected/018e4eef-de5a-47f4-8beb-b8620da26331-kube-api-access-k98cq\") pod \"018e4eef-de5a-47f4-8beb-b8620da26331\" (UID: \"018e4eef-de5a-47f4-8beb-b8620da26331\") " Jul 16 00:55:31.693731 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.693707 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/018e4eef-de5a-47f4-8beb-b8620da26331-kube-api-access-k98cq" (OuterVolumeSpecName: "kube-api-access-k98cq") pod "018e4eef-de5a-47f4-8beb-b8620da26331" (UID: "018e4eef-de5a-47f4-8beb-b8620da26331"). InnerVolumeSpecName "kube-api-access-k98cq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:31.792905 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.792849 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k98cq\" (UniqueName: \"kubernetes.io/projected/018e4eef-de5a-47f4-8beb-b8620da26331-kube-api-access-k98cq\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:55:31.805677 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.805647 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:31.806122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.806104 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="018e4eef-de5a-47f4-8beb-b8620da26331" containerName="test-curl-7552-140009912663328" Jul 16 00:55:31.806204 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.806125 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="018e4eef-de5a-47f4-8beb-b8620da26331" containerName="test-curl-7552-140009912663328" Jul 16 00:55:31.806262 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.806220 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="018e4eef-de5a-47f4-8beb-b8620da26331" containerName="test-curl-7552-140009912663328" Jul 16 00:55:31.809203 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.809185 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:31.816065 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.816044 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:31.894122 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.894099 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42mhj\" (UniqueName: \"kubernetes.io/projected/0b6fb63a-5c70-43cd-bbd1-73046ec2bf35-kube-api-access-42mhj\") pod \"test-curl-7552-140009912663328\" (UID: \"0b6fb63a-5c70-43cd-bbd1-73046ec2bf35\") " pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:31.994476 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:31.994452 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42mhj\" (UniqueName: \"kubernetes.io/projected/0b6fb63a-5c70-43cd-bbd1-73046ec2bf35-kube-api-access-42mhj\") pod \"test-curl-7552-140009912663328\" (UID: \"0b6fb63a-5c70-43cd-bbd1-73046ec2bf35\") " pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:32.003399 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:32.003376 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42mhj\" (UniqueName: \"kubernetes.io/projected/0b6fb63a-5c70-43cd-bbd1-73046ec2bf35-kube-api-access-42mhj\") pod \"test-curl-7552-140009912663328\" (UID: \"0b6fb63a-5c70-43cd-bbd1-73046ec2bf35\") " pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:32.118652 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:32.118595 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:32.250311 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:32.250282 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:32.382433 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:32.382362 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="018e4eef-de5a-47f4-8beb-b8620da26331" path="/var/lib/kubelet/pods/018e4eef-de5a-47f4-8beb-b8620da26331/volumes" Jul 16 00:55:32.507663 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:32.507635 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:32.507781 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:32.507640 2557 scope.go:117] "RemoveContainer" containerID="883b63e113107875a1fb19df198af7da13c9af761e3117d6bc33968fababc0b1" Jul 16 00:55:32.509092 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:32.508991 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912663328" event={"ID":"0b6fb63a-5c70-43cd-bbd1-73046ec2bf35","Type":"ContainerStarted","Data":"ec6e17b2068843d193a224bbba1dad5912a5e4ab45290c15766259cdfe77d35e"} Jul 16 00:55:33.516873 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:33.516843 2557 generic.go:356] "Generic (PLEG): container finished" podID="0b6fb63a-5c70-43cd-bbd1-73046ec2bf35" containerID="808dfd8a68877462e8841ae26cbc415c28656eb13a5fe3bdb00bedc39f117c47" exitCode=0 Jul 16 00:55:33.517244 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:33.516934 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912663328" event={"ID":"0b6fb63a-5c70-43cd-bbd1-73046ec2bf35","Type":"ContainerDied","Data":"808dfd8a68877462e8841ae26cbc415c28656eb13a5fe3bdb00bedc39f117c47"} Jul 16 00:55:34.665474 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.665452 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:34.692542 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.692519 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-140009912663328_0b6fb63a-5c70-43cd-bbd1-73046ec2bf35/test-curl-7552-140009912663328/0.log" Jul 16 00:55:34.717472 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.717452 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42mhj\" (UniqueName: \"kubernetes.io/projected/0b6fb63a-5c70-43cd-bbd1-73046ec2bf35-kube-api-access-42mhj\") pod \"0b6fb63a-5c70-43cd-bbd1-73046ec2bf35\" (UID: \"0b6fb63a-5c70-43cd-bbd1-73046ec2bf35\") " Jul 16 00:55:34.719340 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.719314 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b6fb63a-5c70-43cd-bbd1-73046ec2bf35-kube-api-access-42mhj" (OuterVolumeSpecName: "kube-api-access-42mhj") pod "0b6fb63a-5c70-43cd-bbd1-73046ec2bf35" (UID: "0b6fb63a-5c70-43cd-bbd1-73046ec2bf35"). InnerVolumeSpecName "kube-api-access-42mhj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:34.724336 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.724315 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:34.728593 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.728574 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-140009912663328"] Jul 16 00:55:34.818187 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.818120 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42mhj\" (UniqueName: \"kubernetes.io/projected/0b6fb63a-5c70-43cd-bbd1-73046ec2bf35-kube-api-access-42mhj\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:55:34.849390 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.849363 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:34.849745 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.849733 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b6fb63a-5c70-43cd-bbd1-73046ec2bf35" containerName="test-curl-7552-140009912663328" Jul 16 00:55:34.849745 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.849746 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b6fb63a-5c70-43cd-bbd1-73046ec2bf35" containerName="test-curl-7552-140009912663328" Jul 16 00:55:34.849835 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.849818 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b6fb63a-5c70-43cd-bbd1-73046ec2bf35" containerName="test-curl-7552-140009912663328" Jul 16 00:55:34.852834 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.852819 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:34.856271 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.856247 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:34.919226 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:34.919190 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbjk7\" (UniqueName: \"kubernetes.io/projected/bfb54158-a0e0-4174-a220-1a7192b1368e-kube-api-access-vbjk7\") pod \"test-curl-7552-140009912541520\" (UID: \"bfb54158-a0e0-4174-a220-1a7192b1368e\") " pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:35.020093 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:35.020058 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbjk7\" (UniqueName: \"kubernetes.io/projected/bfb54158-a0e0-4174-a220-1a7192b1368e-kube-api-access-vbjk7\") pod \"test-curl-7552-140009912541520\" (UID: \"bfb54158-a0e0-4174-a220-1a7192b1368e\") " pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:35.029055 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:35.029034 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbjk7\" (UniqueName: \"kubernetes.io/projected/bfb54158-a0e0-4174-a220-1a7192b1368e-kube-api-access-vbjk7\") pod \"test-curl-7552-140009912541520\" (UID: \"bfb54158-a0e0-4174-a220-1a7192b1368e\") " pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:35.163230 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:35.163160 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:35.288028 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:35.288001 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:35.289331 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:55:35.289305 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbfb54158_a0e0_4174_a220_1a7192b1368e.slice/crio-f6a3599b03cee59bfb415475c0cd0f434519d7b785b395f7c8739e09aaf6be67 WatchSource:0}: Error finding container f6a3599b03cee59bfb415475c0cd0f434519d7b785b395f7c8739e09aaf6be67: Status 404 returned error can't find the container with id f6a3599b03cee59bfb415475c0cd0f434519d7b785b395f7c8739e09aaf6be67 Jul 16 00:55:35.529008 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:35.528988 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:35.529120 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:35.529014 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec6e17b2068843d193a224bbba1dad5912a5e4ab45290c15766259cdfe77d35e" Jul 16 00:55:35.530314 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:35.530294 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912541520" event={"ID":"bfb54158-a0e0-4174-a220-1a7192b1368e","Type":"ContainerStarted","Data":"f6a3599b03cee59bfb415475c0cd0f434519d7b785b395f7c8739e09aaf6be67"} Jul 16 00:55:35.540870 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:55:35.540847 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-140009912663328\" is forbidden: User \"system:node:ip-10-0-131-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-255.ec2.internal' and this object" podUID="0b6fb63a-5c70-43cd-bbd1-73046ec2bf35" pod="opendatahub/test-curl-7552-140009912663328" Jul 16 00:55:36.382609 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:36.382574 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b6fb63a-5c70-43cd-bbd1-73046ec2bf35" path="/var/lib/kubelet/pods/0b6fb63a-5c70-43cd-bbd1-73046ec2bf35/volumes" Jul 16 00:55:36.538467 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:36.538432 2557 generic.go:356] "Generic (PLEG): container finished" podID="bfb54158-a0e0-4174-a220-1a7192b1368e" containerID="17156a6ff0c2f3bee0169923e5c35a76e5586b8f4fc5aa4275cfa160837055f2" exitCode=0 Jul 16 00:55:36.538644 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:36.538508 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912541520" event={"ID":"bfb54158-a0e0-4174-a220-1a7192b1368e","Type":"ContainerDied","Data":"17156a6ff0c2f3bee0169923e5c35a76e5586b8f4fc5aa4275cfa160837055f2"} Jul 16 00:55:37.680272 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.680247 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:37.702198 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.702175 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-140009912541520_bfb54158-a0e0-4174-a220-1a7192b1368e/test-curl-7552-140009912541520/0.log" Jul 16 00:55:37.728087 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.728060 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:37.731584 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.731562 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:37.742392 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.742373 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbjk7\" (UniqueName: \"kubernetes.io/projected/bfb54158-a0e0-4174-a220-1a7192b1368e-kube-api-access-vbjk7\") pod \"bfb54158-a0e0-4174-a220-1a7192b1368e\" (UID: \"bfb54158-a0e0-4174-a220-1a7192b1368e\") " Jul 16 00:55:37.744303 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.744280 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb54158-a0e0-4174-a220-1a7192b1368e-kube-api-access-vbjk7" (OuterVolumeSpecName: "kube-api-access-vbjk7") pod "bfb54158-a0e0-4174-a220-1a7192b1368e" (UID: "bfb54158-a0e0-4174-a220-1a7192b1368e"). InnerVolumeSpecName "kube-api-access-vbjk7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:37.843479 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.843428 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbjk7\" (UniqueName: \"kubernetes.io/projected/bfb54158-a0e0-4174-a220-1a7192b1368e-kube-api-access-vbjk7\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:55:37.849150 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.849126 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:37.849521 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.849509 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfb54158-a0e0-4174-a220-1a7192b1368e" containerName="test-curl-7552-140009912541520" Jul 16 00:55:37.849563 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.849523 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfb54158-a0e0-4174-a220-1a7192b1368e" containerName="test-curl-7552-140009912541520" Jul 16 00:55:37.849603 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.849593 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfb54158-a0e0-4174-a220-1a7192b1368e" containerName="test-curl-7552-140009912541520" Jul 16 00:55:37.852634 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.852620 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:37.858139 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.858119 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:37.943748 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:37.943725 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh9c5\" (UniqueName: \"kubernetes.io/projected/9dccc295-9c73-4f84-ae67-2bf9b8866423-kube-api-access-rh9c5\") pod \"test-curl-7552-140009912541520\" (UID: \"9dccc295-9c73-4f84-ae67-2bf9b8866423\") " pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:38.044780 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.044754 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh9c5\" (UniqueName: \"kubernetes.io/projected/9dccc295-9c73-4f84-ae67-2bf9b8866423-kube-api-access-rh9c5\") pod \"test-curl-7552-140009912541520\" (UID: \"9dccc295-9c73-4f84-ae67-2bf9b8866423\") " pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:38.053144 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.053121 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh9c5\" (UniqueName: \"kubernetes.io/projected/9dccc295-9c73-4f84-ae67-2bf9b8866423-kube-api-access-rh9c5\") pod \"test-curl-7552-140009912541520\" (UID: \"9dccc295-9c73-4f84-ae67-2bf9b8866423\") " pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:38.162021 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.161945 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:38.295229 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.295206 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:38.297003 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:55:38.296942 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9dccc295_9c73_4f84_ae67_2bf9b8866423.slice/crio-da2e7f8a339efd098b622ab1952a8b1f84e8b214430a4fe2e0bc6730cc42677e WatchSource:0}: Error finding container da2e7f8a339efd098b622ab1952a8b1f84e8b214430a4fe2e0bc6730cc42677e: Status 404 returned error can't find the container with id da2e7f8a339efd098b622ab1952a8b1f84e8b214430a4fe2e0bc6730cc42677e Jul 16 00:55:38.382823 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.382799 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfb54158-a0e0-4174-a220-1a7192b1368e" path="/var/lib/kubelet/pods/bfb54158-a0e0-4174-a220-1a7192b1368e/volumes" Jul 16 00:55:38.550837 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.550817 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:38.550958 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.550871 2557 scope.go:117] "RemoveContainer" containerID="17156a6ff0c2f3bee0169923e5c35a76e5586b8f4fc5aa4275cfa160837055f2" Jul 16 00:55:38.552152 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:38.552082 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912541520" event={"ID":"9dccc295-9c73-4f84-ae67-2bf9b8866423","Type":"ContainerStarted","Data":"da2e7f8a339efd098b622ab1952a8b1f84e8b214430a4fe2e0bc6730cc42677e"} Jul 16 00:55:39.559879 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:39.559837 2557 generic.go:356] "Generic (PLEG): container finished" podID="9dccc295-9c73-4f84-ae67-2bf9b8866423" containerID="e5b7a86bc189966cd4804e136fabab65bb8f7c74bb03663bf37d0bfb0e900109" exitCode=0 Jul 16 00:55:39.560277 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:39.559933 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7552-140009912541520" event={"ID":"9dccc295-9c73-4f84-ae67-2bf9b8866423","Type":"ContainerDied","Data":"e5b7a86bc189966cd4804e136fabab65bb8f7c74bb03663bf37d0bfb0e900109"} Jul 16 00:55:39.781436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:39.781395 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:39.882118 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:39.882034 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:40.703650 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:40.703626 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:40.725640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:40.725610 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7552-140009912541520_9dccc295-9c73-4f84-ae67-2bf9b8866423/test-curl-7552-140009912541520/0.log" Jul 16 00:55:40.751278 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:40.751248 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:40.755719 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:40.755696 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7552-140009912541520"] Jul 16 00:55:40.766940 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:40.766923 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rh9c5\" (UniqueName: \"kubernetes.io/projected/9dccc295-9c73-4f84-ae67-2bf9b8866423-kube-api-access-rh9c5\") pod \"9dccc295-9c73-4f84-ae67-2bf9b8866423\" (UID: \"9dccc295-9c73-4f84-ae67-2bf9b8866423\") " Jul 16 00:55:40.768801 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:40.768776 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9dccc295-9c73-4f84-ae67-2bf9b8866423-kube-api-access-rh9c5" (OuterVolumeSpecName: "kube-api-access-rh9c5") pod "9dccc295-9c73-4f84-ae67-2bf9b8866423" (UID: "9dccc295-9c73-4f84-ae67-2bf9b8866423"). InnerVolumeSpecName "kube-api-access-rh9c5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:55:40.867583 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:40.867533 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rh9c5\" (UniqueName: \"kubernetes.io/projected/9dccc295-9c73-4f84-ae67-2bf9b8866423-kube-api-access-rh9c5\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:55:41.283145 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:41.283120 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:41.572205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:41.572129 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:41.572205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:41.572158 2557 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da2e7f8a339efd098b622ab1952a8b1f84e8b214430a4fe2e0bc6730cc42677e" Jul 16 00:55:41.581903 ip-10-0-131-255 kubenswrapper[2557]: E0716 00:55:41.581878 2557 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7552-140009912541520\" is forbidden: User \"system:node:ip-10-0-131-255.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-131-255.ec2.internal' and this object" podUID="9dccc295-9c73-4f84-ae67-2bf9b8866423" pod="opendatahub/test-curl-7552-140009912541520" Jul 16 00:55:42.382233 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:42.382200 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9dccc295-9c73-4f84-ae67-2bf9b8866423" path="/var/lib/kubelet/pods/9dccc295-9c73-4f84-ae67-2bf9b8866423/volumes" Jul 16 00:55:47.890595 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:47.890565 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:47.991096 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:47.991062 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:48.321542 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:48.321515 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:48.467819 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:48.467790 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:48.924453 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:48.924425 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:55.288274 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:55.288231 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:55.348838 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:55.348809 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:55.541408 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:55.541317 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8"] Jul 16 00:55:55.541576 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:55.541548 2557 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" containerID="cri-o://c6064c127683037c06eaa09806dd8076ba2042614489da1aa45654d524e7a6da" gracePeriod=30 Jul 16 00:55:55.576312 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:55.576283 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:55.785327 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:55.785295 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:55:56.203233 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:55:56.203208 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9cb9f5fd-5rnvc_68b686de-81cc-4ef8-a7bf-74440dcc7089/authorino/0.log" Jul 16 00:56:00.696012 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.695957 2557 generic.go:356] "Generic (PLEG): container finished" podID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerID="c6064c127683037c06eaa09806dd8076ba2042614489da1aa45654d524e7a6da" exitCode=0 Jul 16 00:56:00.696012 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.695991 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" event={"ID":"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee","Type":"ContainerDied","Data":"c6064c127683037c06eaa09806dd8076ba2042614489da1aa45654d524e7a6da"} Jul 16 00:56:00.696436 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.696050 2557 scope.go:117] "RemoveContainer" containerID="9ea323ffe617bfd76c681dc5e2da2bf13b47403935b729cba08a4a8c0f8246d8" Jul 16 00:56:00.795887 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.795863 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:56:00.929865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.929805 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-certs\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.929865 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.929842 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-credential-socket\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930083 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.929887 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-podinfo\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930083 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.929926 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jz2ph\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-kube-api-access-jz2ph\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930083 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.929956 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-envoy\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930083 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930010 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-data\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930083 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930053 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istiod-ca-cert\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930334 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930093 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-token\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930334 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930113 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:56:00.930334 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930125 2557 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-socket\") pod \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\" (UID: \"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee\") " Jul 16 00:56:00.930334 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930261 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:56:00.930522 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930464 2557 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-certs\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:00.930522 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930477 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:56:00.930522 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930483 2557 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-credential-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:00.930522 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930504 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 16 00:56:00.930934 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.930910 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-data" (OuterVolumeSpecName: "istio-data") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:56:00.932231 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.932202 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-kube-api-access-jz2ph" (OuterVolumeSpecName: "kube-api-access-jz2ph") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "kube-api-access-jz2ph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:56:00.932322 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.932236 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-token" (OuterVolumeSpecName: "istio-token") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 16 00:56:00.932458 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.932432 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 16 00:56:00.932548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:00.932440 2557 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" (UID: "b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 16 00:56:01.031679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.031653 2557 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-podinfo\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:01.031679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.031675 2557 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jz2ph\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-kube-api-access-jz2ph\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:01.031679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.031684 2557 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-envoy\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:01.031859 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.031692 2557 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-data\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:01.031859 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.031701 2557 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istiod-ca-cert\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:01.031859 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.031708 2557 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-istio-token\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:01.031859 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.031716 2557 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee-workload-socket\") on node \"ip-10-0-131-255.ec2.internal\" DevicePath \"\"" Jul 16 00:56:01.703194 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.703164 2557 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" Jul 16 00:56:01.703626 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.703205 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8" event={"ID":"b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee","Type":"ContainerDied","Data":"c332cdfa7a69e54adc8f7b80d9f23b5537f8cff3283669082ff54d4c12f6b526"} Jul 16 00:56:01.703626 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.703259 2557 scope.go:117] "RemoveContainer" containerID="c6064c127683037c06eaa09806dd8076ba2042614489da1aa45654d524e7a6da" Jul 16 00:56:01.741650 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.741622 2557 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8"] Jul 16 00:56:01.751484 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.751462 2557 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-07a8dc-openshift-default-f6544fbc-tglh8"] Jul 16 00:56:01.956150 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:01.956076 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2kdsh_623e2dc9-a29c-4ffb-81b2-8357375e7001/server/0.log" Jul 16 00:56:02.076183 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:02.076151 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rgk4f_8cdc0e39-12ba-48e8-ab22-bd3468c089d2/manager/0.log" Jul 16 00:56:02.382684 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:02.382656 2557 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" path="/var/lib/kubelet/pods/b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee/volumes" Jul 16 00:56:02.460640 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:02.460618 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-pk2gp_36590293-402e-4d77-aa83-b702c3eb5cc5/copy-manifests/0.log" Jul 16 00:56:02.468074 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:02.468050 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-pk2gp_36590293-402e-4d77-aa83-b702c3eb5cc5/manager/0.log" Jul 16 00:56:03.065596 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:03.065567 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-a-c6bb64-664bd86b9b-687p5_54d37686-dfe1-4118-a289-de2b890202e2/maas-api/0.log" Jul 16 00:56:03.180355 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:03.180333 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-cc8d5c-7d59c5c9b6-pt2fq_75a69fb9-f270-4d93-9235-362759a57ce7/maas-api/0.log" Jul 16 00:56:03.417205 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:03.417129 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-inf-a-a70600-7bb76c66c6-q58g7_de04c8b6-2aaf-4343-911c-72ec83f92659/maas-api/0.log" Jul 16 00:56:03.883679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:03.883648 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-7ee350-78db995b6f-szm7h_e1f97413-535a-42ea-9a00-fca64b608fbe/maas-api/0.log" Jul 16 00:56:04.013776 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:04.013750 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-07a8dc-7bd4964874-c7xtv_ba7e9e2e-8acf-4bf1-8f39-99f2e228ba4c/maas-api/0.log" Jul 16 00:56:04.123453 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:04.123435 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736030-s8lsf_60a74346-4ad4-4cbb-94fa-63d925e55d00/cleanup/0.log" Jul 16 00:56:04.233709 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:04.233689 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29736045-r49sl_b3e2397d-f900-4ef0-9458-5589640e6c24/cleanup/0.log" Jul 16 00:56:04.347282 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:04.347262 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-b9cb77e6-29736045-gt6jn_3067561e-31b4-41b7-af6d-76f71b4581a6/cleanup/0.log" Jul 16 00:56:04.568578 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:04.568508 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-4b7f7df8-29736045-dkg8n_eeca7c12-8b31-4047-be92-a92bfd922ce4/cleanup/0.log" Jul 16 00:56:05.452424 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.452393 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss_c0938401-5843-4035-877c-14c1be081213/util/0.log" Jul 16 00:56:05.459886 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.459856 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss_c0938401-5843-4035-877c-14c1be081213/pull/0.log" Jul 16 00:56:05.467063 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.467040 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss_c0938401-5843-4035-877c-14c1be081213/extract/0.log" Jul 16 00:56:05.581352 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.581324 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr_245e3114-4a00-434c-b8ed-50547f9a40e7/util/0.log" Jul 16 00:56:05.589883 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.589864 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr_245e3114-4a00-434c-b8ed-50547f9a40e7/pull/0.log" Jul 16 00:56:05.596316 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.596287 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr_245e3114-4a00-434c-b8ed-50547f9a40e7/extract/0.log" Jul 16 00:56:05.710407 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.710337 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww_c0893b73-e213-4ade-aeff-c631fc181d00/pull/0.log" Jul 16 00:56:05.717517 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.717501 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww_c0893b73-e213-4ade-aeff-c631fc181d00/extract/0.log" Jul 16 00:56:05.724732 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.724712 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww_c0893b73-e213-4ade-aeff-c631fc181d00/util/0.log" Jul 16 00:56:05.838374 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.838352 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6_bbb4193d-e982-4ebe-ae41-45c04edbbb5e/util/0.log" Jul 16 00:56:05.845315 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.845296 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6_bbb4193d-e982-4ebe-ae41-45c04edbbb5e/pull/0.log" Jul 16 00:56:05.852490 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.852475 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6_bbb4193d-e982-4ebe-ae41-45c04edbbb5e/extract/0.log" Jul 16 00:56:05.969251 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:05.969172 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9cb9f5fd-5rnvc_68b686de-81cc-4ef8-a7bf-74440dcc7089/authorino/0.log" Jul 16 00:56:07.428431 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:07.428404 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-5d2rb_d42cab0b-d8aa-4e79-99a6-09f72246cbd5/kube-auth-proxy/0.log" Jul 16 00:56:07.655804 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:07.655775 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9nff2_190ec2b1-33ff-4db9-98d2-9e25495283c3/istio-proxy/1.log" Jul 16 00:56:08.000598 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:08.000576 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774b4878-z7tnc_f06db588-0616-4879-966d-9abe1add02e6/router/0.log" Jul 16 00:56:08.586447 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:08.586420 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-nkspl_e219c125-22b3-4f5c-8b8f-92b8cfbd4743/main/0.log" Jul 16 00:56:14.226896 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.226856 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lvdqh/must-gather-bjtz7"] Jul 16 00:56:14.227317 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227302 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" Jul 16 00:56:14.227362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227318 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" Jul 16 00:56:14.227362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227332 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9dccc295-9c73-4f84-ae67-2bf9b8866423" containerName="test-curl-7552-140009912541520" Jul 16 00:56:14.227362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227338 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="9dccc295-9c73-4f84-ae67-2bf9b8866423" containerName="test-curl-7552-140009912541520" Jul 16 00:56:14.227362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227350 2557 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" Jul 16 00:56:14.227362 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227355 2557 state_mem.go:107] "Deleted CPUSet assignment" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" Jul 16 00:56:14.227512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227415 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="9dccc295-9c73-4f84-ae67-2bf9b8866423" containerName="test-curl-7552-140009912541520" Jul 16 00:56:14.227512 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227422 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" Jul 16 00:56:14.227578 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.227537 2557 memory_manager.go:368] "RemoveStaleState removing state" podUID="b4c49077-76f7-4e2a-8f0c-a9eb8d26c5ee" containerName="istio-proxy" Jul 16 00:56:14.230015 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.229993 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:14.232258 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.232241 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.235004 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.234954 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lvdqh\"/\"kube-root-ca.crt\"" Jul 16 00:56:14.235101 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.235072 2557 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lvdqh\"/\"default-dockercfg-zvzsp\"" Jul 16 00:56:14.236162 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.236147 2557 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lvdqh\"/\"openshift-service-ca.crt\"" Jul 16 00:56:14.241069 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.241049 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvdqh/must-gather-bjtz7"] Jul 16 00:56:14.335622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.335582 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b817ad4-70cb-44c1-8838-058e4b489607-must-gather-output\") pod \"must-gather-bjtz7\" (UID: \"1b817ad4-70cb-44c1-8838-058e4b489607\") " pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.335622 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.335620 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfhdq\" (UniqueName: \"kubernetes.io/projected/1b817ad4-70cb-44c1-8838-058e4b489607-kube-api-access-wfhdq\") pod \"must-gather-bjtz7\" (UID: \"1b817ad4-70cb-44c1-8838-058e4b489607\") " pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.345137 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.345106 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:14.436639 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.436606 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b817ad4-70cb-44c1-8838-058e4b489607-must-gather-output\") pod \"must-gather-bjtz7\" (UID: \"1b817ad4-70cb-44c1-8838-058e4b489607\") " pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.436639 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.436645 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfhdq\" (UniqueName: \"kubernetes.io/projected/1b817ad4-70cb-44c1-8838-058e4b489607-kube-api-access-wfhdq\") pod \"must-gather-bjtz7\" (UID: \"1b817ad4-70cb-44c1-8838-058e4b489607\") " pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.436925 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.436908 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/1b817ad4-70cb-44c1-8838-058e4b489607-must-gather-output\") pod \"must-gather-bjtz7\" (UID: \"1b817ad4-70cb-44c1-8838-058e4b489607\") " pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.450760 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.450736 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfhdq\" (UniqueName: \"kubernetes.io/projected/1b817ad4-70cb-44c1-8838-058e4b489607-kube-api-access-wfhdq\") pod \"must-gather-bjtz7\" (UID: \"1b817ad4-70cb-44c1-8838-058e4b489607\") " pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.542989 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.542953 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvdqh/must-gather-bjtz7" Jul 16 00:56:14.678560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.678534 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvdqh/must-gather-bjtz7"] Jul 16 00:56:14.680114 ip-10-0-131-255 kubenswrapper[2557]: W0716 00:56:14.680087 2557 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1b817ad4_70cb_44c1_8838_058e4b489607.slice/crio-727b529aca85c542cf43f3474ebc7dad203c10cc2ab78a051800941b1d4c85ad WatchSource:0}: Error finding container 727b529aca85c542cf43f3474ebc7dad203c10cc2ab78a051800941b1d4c85ad: Status 404 returned error can't find the container with id 727b529aca85c542cf43f3474ebc7dad203c10cc2ab78a051800941b1d4c85ad Jul 16 00:56:14.779548 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:14.779516 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvdqh/must-gather-bjtz7" event={"ID":"1b817ad4-70cb-44c1-8838-058e4b489607","Type":"ContainerStarted","Data":"727b529aca85c542cf43f3474ebc7dad203c10cc2ab78a051800941b1d4c85ad"} Jul 16 00:56:15.788726 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:15.788697 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvdqh/must-gather-bjtz7" event={"ID":"1b817ad4-70cb-44c1-8838-058e4b489607","Type":"ContainerStarted","Data":"ccf93a7cf58438f6bb0243e9d675895edf8d8ae1cbe160b80acdf4c8c093ee14"} Jul 16 00:56:16.798099 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:16.798064 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvdqh/must-gather-bjtz7" event={"ID":"1b817ad4-70cb-44c1-8838-058e4b489607","Type":"ContainerStarted","Data":"c6064ef385453e5d4f619706daae068b21f060cac160aa53b31defa41bad55b9"} Jul 16 00:56:16.819170 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:16.819106 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lvdqh/must-gather-bjtz7" podStartSLOduration=1.862601915 podStartE2EDuration="2.81908535s" totalImagesPullingTime="956.483435ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-16 00:56:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:16.814609159 +0000 UTC m=+2612.882472460" watchObservedRunningTime="2026-07-16 00:56:16.81908535 +0000 UTC m=+2612.886948638" Jul 16 00:56:17.122076 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:17.121995 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-92z4p_a89f1a0c-990c-4c98-bf3f-67ddc8b2d0d0/global-pull-secret-syncer/0.log" Jul 16 00:56:17.252560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:17.252526 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" Jul 16 00:56:17.357493 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:17.357459 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-255.ec2.internal_091fefe17ee534afe3f758c9b12630fb/haproxy/0.log" Jul 16 00:56:21.299849 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.299812 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss_c0938401-5843-4035-877c-14c1be081213/extract/0.log" Jul 16 00:56:21.348743 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.348241 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss_c0938401-5843-4035-877c-14c1be081213/util/0.log" Jul 16 00:56:21.401389 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.401362 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759j46ss_c0938401-5843-4035-877c-14c1be081213/pull/0.log" Jul 16 00:56:21.462704 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.462678 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr_245e3114-4a00-434c-b8ed-50547f9a40e7/extract/0.log" Jul 16 00:56:21.513014 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.512922 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr_245e3114-4a00-434c-b8ed-50547f9a40e7/util/0.log" Jul 16 00:56:21.573540 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.573514 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e05hdnr_245e3114-4a00-434c-b8ed-50547f9a40e7/pull/0.log" Jul 16 00:56:21.634134 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.634070 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww_c0893b73-e213-4ade-aeff-c631fc181d00/extract/0.log" Jul 16 00:56:21.676999 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.676887 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww_c0893b73-e213-4ade-aeff-c631fc181d00/util/0.log" Jul 16 00:56:21.706972 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.706924 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73j9fww_c0893b73-e213-4ade-aeff-c631fc181d00/pull/0.log" Jul 16 00:56:21.754197 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.754167 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6_bbb4193d-e982-4ebe-ae41-45c04edbbb5e/extract/0.log" Jul 16 00:56:21.779071 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.778957 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6_bbb4193d-e982-4ebe-ae41-45c04edbbb5e/util/0.log" Jul 16 00:56:21.804176 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:21.804149 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1pq7h6_bbb4193d-e982-4ebe-ae41-45c04edbbb5e/pull/0.log" Jul 16 00:56:22.215178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:22.215094 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-d9cb9f5fd-5rnvc_68b686de-81cc-4ef8-a7bf-74440dcc7089/authorino/0.log" Jul 16 00:56:24.508985 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:24.508868 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-hprns_d947280c-42ee-4fea-a2a9-bec881864104/cluster-monitoring-operator/0.log" Jul 16 00:56:24.689183 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:24.689049 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-q2z4l_a7fed17f-7940-40bb-ab6f-6868dca87cb3/monitoring-plugin/0.log" Jul 16 00:56:24.838416 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:24.838389 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntbqj_ec8b91fb-2650-4ea2-bb38-e0933fe512dc/node-exporter/0.log" Jul 16 00:56:24.868013 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:24.867980 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntbqj_ec8b91fb-2650-4ea2-bb38-e0933fe512dc/kube-rbac-proxy/0.log" Jul 16 00:56:24.890383 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:24.890359 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ntbqj_ec8b91fb-2650-4ea2-bb38-e0933fe512dc/init-textfile/0.log" Jul 16 00:56:25.250562 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.250522 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2v897_96c0eca8-9253-4d39-8244-bfb54c7718f8/prometheus-operator/0.log" Jul 16 00:56:25.270143 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.270104 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-2v897_96c0eca8-9253-4d39-8244-bfb54c7718f8/kube-rbac-proxy/0.log" Jul 16 00:56:25.292688 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.292656 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-sfqpj_8ccd9ccf-db6b-4c35-9148-f94d5b9a7972/prometheus-operator-admission-webhook/0.log" Jul 16 00:56:25.408203 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.408167 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77584cdf4-xnqpl_47b5c890-4b25-4faf-b410-571bfd8626e9/thanos-query/0.log" Jul 16 00:56:25.430404 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.430356 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77584cdf4-xnqpl_47b5c890-4b25-4faf-b410-571bfd8626e9/kube-rbac-proxy-web/0.log" Jul 16 00:56:25.450324 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.450288 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77584cdf4-xnqpl_47b5c890-4b25-4faf-b410-571bfd8626e9/kube-rbac-proxy/0.log" Jul 16 00:56:25.471684 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.471652 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77584cdf4-xnqpl_47b5c890-4b25-4faf-b410-571bfd8626e9/prom-label-proxy/0.log" Jul 16 00:56:25.490879 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.490852 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77584cdf4-xnqpl_47b5c890-4b25-4faf-b410-571bfd8626e9/kube-rbac-proxy-rules/0.log" Jul 16 00:56:25.511022 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:25.510924 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77584cdf4-xnqpl_47b5c890-4b25-4faf-b410-571bfd8626e9/kube-rbac-proxy-metrics/0.log" Jul 16 00:56:26.665830 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.665805 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-gvm7j_2349fdd8-9fb4-4277-bf29-4119d44e9997/networking-console-plugin/0.log" Jul 16 00:56:26.688040 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.688009 2557 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7"] Jul 16 00:56:26.694411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.694383 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.705439 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.705415 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7"] Jul 16 00:56:26.761635 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.761593 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-lib-modules\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.761831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.761715 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-sys\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.761831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.761749 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-proc\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.761831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.761783 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-podres\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.761831 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.761806 2557 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9n6w\" (UniqueName: \"kubernetes.io/projected/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-kube-api-access-m9n6w\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.862931 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.862894 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-lib-modules\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863135 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863023 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-sys\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863135 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863047 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-proc\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863135 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863073 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-podres\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863135 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863096 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-lib-modules\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863143 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-sys\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863155 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-proc\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863172 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-podres\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.863349 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.863186 2557 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9n6w\" (UniqueName: \"kubernetes.io/projected/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-kube-api-access-m9n6w\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:26.872068 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:26.872037 2557 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9n6w\" (UniqueName: \"kubernetes.io/projected/bda00cf6-d76f-47ab-a8c1-46a30d4cc184-kube-api-access-m9n6w\") pod \"perf-node-gather-daemonset-s8hw7\" (UID: \"bda00cf6-d76f-47ab-a8c1-46a30d4cc184\") " pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:27.010475 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:27.010438 2557 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:27.214374 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:27.214346 2557 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7"] Jul 16 00:56:27.907063 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:27.907020 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" event={"ID":"bda00cf6-d76f-47ab-a8c1-46a30d4cc184","Type":"ContainerStarted","Data":"5720a00d991c3a4a9493622c6203172bf61631178280eade01a167cd91608a0a"} Jul 16 00:56:27.907547 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:27.907094 2557 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" event={"ID":"bda00cf6-d76f-47ab-a8c1-46a30d4cc184","Type":"ContainerStarted","Data":"a51594c83901e026df29b91df60ebe3072a4f4104912ee3280cdca8f0b0c2e30"} Jul 16 00:56:27.907924 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:27.907895 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:27.930284 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:27.930223 2557 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" podStartSLOduration=1.930203731 podStartE2EDuration="1.930203731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-16 00:56:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-16 00:56:27.925501925 +0000 UTC m=+2623.993365214" watchObservedRunningTime="2026-07-16 00:56:27.930203731 +0000 UTC m=+2623.998067020" Jul 16 00:56:28.391560 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:28.391533 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-k84z2_884752ee-822d-4936-8c43-54cbe3ec56d7/volume-data-source-validator/0.log" Jul 16 00:56:29.359147 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:29.359119 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8c8t6_5731da3f-fd39-4944-a7b0-ecc6b88bbccd/dns/0.log" Jul 16 00:56:29.381695 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:29.381665 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8c8t6_5731da3f-fd39-4944-a7b0-ecc6b88bbccd/kube-rbac-proxy/0.log" Jul 16 00:56:29.524312 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:29.524285 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-p4s2z_d617bf3a-d495-485e-911d-8d2d7fb978d1/dns-node-resolver/0.log" Jul 16 00:56:30.090127 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:30.090101 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ln44r_8711c01b-c938-4538-8c1d-608395be7031/node-ca/0.log" Jul 16 00:56:31.152582 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:31.152553 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-5d2rb_d42cab0b-d8aa-4e79-99a6-09f72246cbd5/kube-auth-proxy/0.log" Jul 16 00:56:31.210664 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:31.210637 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9nff2_190ec2b1-33ff-4db9-98d2-9e25495283c3/istio-proxy/0.log" Jul 16 00:56:31.252700 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:31.252650 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9nff2_190ec2b1-33ff-4db9-98d2-9e25495283c3/istio-proxy/1.log" Jul 16 00:56:31.339145 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:31.339111 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774b4878-z7tnc_f06db588-0616-4879-966d-9abe1add02e6/router/0.log" Jul 16 00:56:32.051148 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:32.051118 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xl2bf_bfc590a9-0257-4e81-8ae1-13d8be2b7098/serve-healthcheck-canary/0.log" Jul 16 00:56:32.526443 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:32.526411 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-wfgpj_05919e70-19c6-4b38-aa0d-b031cb6ca19e/insights-operator/0.log" Jul 16 00:56:32.526910 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:32.526869 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-wfgpj_05919e70-19c6-4b38-aa0d-b031cb6ca19e/insights-operator/1.log" Jul 16 00:56:32.550902 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:32.550879 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqlwt_32f297a0-6414-4518-b18e-908d867d4926/kube-rbac-proxy/0.log" Jul 16 00:56:32.574542 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:32.574520 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqlwt_32f297a0-6414-4518-b18e-908d867d4926/exporter/0.log" Jul 16 00:56:32.595710 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:32.595683 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lqlwt_32f297a0-6414-4518-b18e-908d867d4926/extractor/0.log" Jul 16 00:56:34.941098 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:34.941069 2557 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-lvdqh/perf-node-gather-daemonset-s8hw7" Jul 16 00:56:34.966151 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:34.966125 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-2kdsh_623e2dc9-a29c-4ffb-81b2-8357375e7001/server/0.log" Jul 16 00:56:35.039646 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:35.039618 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-rgk4f_8cdc0e39-12ba-48e8-ab22-bd3468c089d2/manager/0.log" Jul 16 00:56:35.202896 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:35.202826 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-pk2gp_36590293-402e-4d77-aa83-b702c3eb5cc5/manager/0.log" Jul 16 00:56:35.222509 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:35.222383 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-dd579ccfb-pk2gp_36590293-402e-4d77-aa83-b702c3eb5cc5/copy-manifests/0.log" Jul 16 00:56:36.420420 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:36.420392 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-58f9b8cc9c-mhpt6_f5fadcee-706f-41e9-899c-fb5f4dc30599/manager/0.log" Jul 16 00:56:36.757097 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:36.757070 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-5d2rb_d42cab0b-d8aa-4e79-99a6-09f72246cbd5/kube-auth-proxy/0.log" Jul 16 00:56:36.800559 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:36.800483 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9nff2_190ec2b1-33ff-4db9-98d2-9e25495283c3/istio-proxy/0.log" Jul 16 00:56:36.845036 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:36.845001 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9nff2_190ec2b1-33ff-4db9-98d2-9e25495283c3/istio-proxy/1.log" Jul 16 00:56:36.905614 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:36.905579 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774b4878-z7tnc_f06db588-0616-4879-966d-9abe1add02e6/router/0.log" Jul 16 00:56:37.260982 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:37.260740 2557 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7sjtn_557c760c-f5bb-4e10-a5ea-df6daebb5c45/konnectivity-agent/0.log" limit=1024 Jul 16 00:56:38.291881 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:38.291805 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-76b5c6c765-5d2rb_d42cab0b-d8aa-4e79-99a6-09f72246cbd5/kube-auth-proxy/0.log" Jul 16 00:56:38.328872 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:38.328840 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9nff2_190ec2b1-33ff-4db9-98d2-9e25495283c3/istio-proxy/0.log" Jul 16 00:56:38.367809 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:38.367783 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-9nff2_190ec2b1-33ff-4db9-98d2-9e25495283c3/istio-proxy/1.log" Jul 16 00:56:38.421942 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:38.421916 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-774b4878-z7tnc_f06db588-0616-4879-966d-9abe1add02e6/router/0.log" Jul 16 00:56:41.428332 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:41.428307 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4xrmq_e509055a-d4bf-430e-97b9-d7e2b2833829/migrator/0.log" Jul 16 00:56:41.447603 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:41.447577 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-4xrmq_e509055a-d4bf-430e-97b9-d7e2b2833829/graceful-termination/0.log" Jul 16 00:56:43.040702 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.040672 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-stns6_8b6df3a6-3d16-4cce-8eec-bec871402de0/kube-multus-additional-cni-plugins/0.log" Jul 16 00:56:43.063352 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.063325 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-stns6_8b6df3a6-3d16-4cce-8eec-bec871402de0/egress-router-binary-copy/0.log" Jul 16 00:56:43.083326 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.083303 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-stns6_8b6df3a6-3d16-4cce-8eec-bec871402de0/cni-plugins/0.log" Jul 16 00:56:43.106033 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.106012 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-stns6_8b6df3a6-3d16-4cce-8eec-bec871402de0/bond-cni-plugin/0.log" Jul 16 00:56:43.124679 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.124662 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-stns6_8b6df3a6-3d16-4cce-8eec-bec871402de0/routeoverride-cni/0.log" Jul 16 00:56:43.144178 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.144161 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-stns6_8b6df3a6-3d16-4cce-8eec-bec871402de0/whereabouts-cni-bincopy/0.log" Jul 16 00:56:43.163438 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.163422 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-stns6_8b6df3a6-3d16-4cce-8eec-bec871402de0/whereabouts-cni/0.log" Jul 16 00:56:43.230343 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.230318 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-p8gxj_f0a0ee7e-5f33-4cdb-b5a9-05a0530ccc7a/kube-multus/0.log" Jul 16 00:56:43.362686 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.362614 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lf7sl_60590034-ae94-403d-8bcd-0092f90dbbfe/network-metrics-daemon/0.log" Jul 16 00:56:43.380716 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:43.380692 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-lf7sl_60590034-ae94-403d-8bcd-0092f90dbbfe/kube-rbac-proxy/0.log" Jul 16 00:56:44.563192 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.563159 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-controller/0.log" Jul 16 00:56:44.582054 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.582024 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/1.log" Jul 16 00:56:44.582255 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.582103 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/ovn-acl-logging/0.log" Jul 16 00:56:44.604986 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.604945 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/kube-rbac-proxy-node/0.log" Jul 16 00:56:44.628766 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.628741 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/kube-rbac-proxy-ovn-metrics/0.log" Jul 16 00:56:44.647411 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.647390 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/northd/0.log" Jul 16 00:56:44.671784 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.671763 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/nbdb/0.log" Jul 16 00:56:44.696608 ip-10-0-131-255 kubenswrapper[2557]: I0716 00:56:44.696585 2557 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wvknh_d3ddd0bd-27bf-4f8c-bdc2-ae4b8c0aa870/sbdb/0.log"